00000001:02000400:0.0F:1788744101.156672:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788744117.337050:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788744118.954712:0:3583:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 735 MB/s 00000001:01000000:0.0:1788744119.209239:0:3583:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 830 MB/s 00000001:01000000:2.0F:1788744119.459253:0:3583:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6487 MB/s 00000020:02000000:0.0:1788744119.998947:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_44_g07a5b2c 00000400:02000000:0.0:1788744120.717328:0:3627:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.104@tcp [8/256/0/180] 00008000:02000000:2.0:1788744123.966575:0:3776:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788744181.525136:0:5743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788744194.257101:0:6493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788744194.257107:0:6493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788744194.257109:0:6493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788744194.257258:0:6493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bc6ef5af 00000080:02000400:1.0:1788744194.257269:0:6493:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788744194.266644:0:6493:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788744194.266658:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788744194.266694:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e4d27b4b) 00000020:00000080:1.0:1788744194.266713:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788744194.337968:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788744194.338036:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788744194.380067:0:6493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788744194.380365:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788744194.380372:0:6493:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788744194.380383:0:6493:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbc7b 00000020:01000004:0.0:1788744194.380390:0:6493:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788744194.380394:0:6493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788744194.380398:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc6ef5af from MGS 00000020:01000004:0.0:1788744194.380434:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788744194.380453:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008ce94913) 00000020:00000080:0.0:1788744194.380465:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788744194.380582:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc6ef5af from MGS, refs=2 00080000:01000000:0.0:1788744194.380588:0:6493:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744194.380594:0:6493:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbc89 00000100:00100000:0.0:1788744194.380679:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788744194.380817:0:6493:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788744194.380824:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788744194.381379:0:6493:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788744194.381386:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788744194.382998:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744194.383152:0:6493:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788744194.383158:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788744194.384280:0:6493:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788744194.384288:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788744194.387780:0:6493:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788744194.387792:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788744194.388741:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744194.388744:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744194.388752:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744194.389041:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744194.389043:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744194.389053:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744194.390060:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788744194.392038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788744194.639676:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2479 MB/s 00000001:01000000:3.0:1788744194.889679:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5579 MB/s 00000001:01000000:2.0:1788744195.140328:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1067 MB/s 00000001:01000000:2.0:1788744195.391693:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 791 MB/s 00080000:10000000:2.0:1788744195.399999:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788744195.418785:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788744195.420628:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788744195.420670:0:6493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788744195.420706:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788744195.420844:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788744195.420864:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788744195.421131:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744195.421345:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788744195.421351:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788744195.422275:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788744195.422282:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788744195.422722:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788744195.422729:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788744195.423287:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788744195.423308:0:6493:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:0.0:1788744195.423310:0:6493:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788744195.423360:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:0.0:1788744195.423371:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (00000000aecdd0a6) 00000020:00000080:0.0:1788744195.423385:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788744195.423488:0:6493:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000cbfb5317@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788744195.423644:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:0.0:1788744195.423649:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788744195.425215:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788744195.425304:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid 46c76a72-ee71-482d-9002-d7642a89bcb9) 00000020:00000080:2.0:1788744195.425322:0:6493:0:(genops.c:1384:class_connect()) connect: client 46c76a72-ee71-482d-9002-d7642a89bcb9, cookie 0xb6207a6e76dcbc97 00000100:00080000:2.0:1788744195.425332:0:6493:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744195.425339:0:6493:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import 00000000cbfb5317 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744195.425377:0:6493:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007e1a7dd1 x1875634154373248/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744195.425398:0:6493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS 00000020:01000004:2.0:1788744195.425436:0:6493:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788744195.425442:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788744195.425459:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e69155ca) 00000020:00000080:2.0:1788744195.425469:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1788744195.426431:0:6512:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788744195.426553:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e1a7dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154373248:0@lo:250: 00000100:00100000:3.0:1788744195.426651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744195.427224:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154373248 00000100:00100000:3.0:1788744195.427233:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154373248 00000100:00100000:3.0:1788744195.427325:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744195.427332:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b59cc45f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875634154373248:12345-0@lo:250: 00010000:00080000:3.0:1788744195.427355:0:6509:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 46c76a72-ee71-482d-9002-d7642a89bcb9@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1788744195.427382:0:6509:0:(genops.c:1384:class_connect()) connect: client 46c76a72-ee71-482d-9002-d7642a89bcb9, cookie 0xb6207a6e76dcbca5 00000100:00080000:3.0:1788744195.427524:0:6509:0:(import.c:65:import_set_state_nolock()) 0000000013ab2c4e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744195.427582:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b59cc45f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:3642:x1875634154373248:12345-0@lo:250: Request processed in 249us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744195.427591:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744195.427634:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788744195.427642:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1788744195.427650:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788744195.427654:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788744195.427657:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000cbfb5317 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788744195.427659:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788744195.427666:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788744195.427670:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e1a7dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154373248:0@lo:250: 00000100:00100000:1.0:1788744195.439061:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.439336:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788744195.439345:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788744195.440037:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744195.440046:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788744195.440264:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744195.440271:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788744195.440943:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.441137:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788744195.441143:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788744195.447003:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788744195.447034:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:2.0:1788744195.447802:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744195.476955:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.477162:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788744195.477169:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788744195.478925:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788744195.478936:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788744195.479626:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.479791:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788744195.479797:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788744195.480286:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788744195.480293:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788744195.480931:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.481070:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788744195.481074:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788744195.481969:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788744195.481978:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788744195.482764:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.482904:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788744195.482908:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788744195.483272:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788744195.483277:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788744195.498996:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744195.499183:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788744195.499189:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788744195.501092:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744195.501109:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788744195.501937:0:6493:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744195.501944:0:6493:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788744195.503086:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788744195.503113:0:6493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788744195.503120:0:6493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788744195.503212:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744195.503315:0:6493:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788744195.503320:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744195.503321:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744195.503322:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744195.503323:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744195.503325:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744195.503326:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744195.503327:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744195.503328:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744195.503329:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744195.503330:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744195.503331:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744195.503333:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744195.503335:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788744195.503337:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744195.503338:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744195.503339:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744195.503340:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744195.503341:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744195.503342:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744195.503342:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744195.503344:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744195.503350:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744195.503350:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744195.503351:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744195.503352:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744195.503382:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788744195.503397:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ac4e6a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373376:0@lo:253: 00000100:00100000:1.0:1788744195.505869:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.506020:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1d16a07 going to sleep for 11 seconds 00000100:00100000:3.0:1788744195.506322:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154373376 00000100:00100000:3.0:1788744195.506332:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154373376 00000100:00100000:3.0:1788744195.506439:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744195.506448:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af10923c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6493:x1875634154373376:12345-0@lo:253: 20000000:01000000:3.0:1788744195.506495:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788744195.506498:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788744195.508335:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788744195.508397:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788744195.508765:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744195.533432:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788744195.538307:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788744195.538315:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788744195.538321:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788744195.538323:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788744195.538338:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788744195.541774:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744195.541905:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788744195.541917:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788744195.541929:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788744195.541937:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788744195.541950:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788744195.542306:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788744195.542315:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788744195.542329:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788744195.542334:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788744195.542346:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788744195.542351:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788744195.542364:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788744195.542378:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788744195.542434:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788744195.542440:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788744195.542448:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744195.542535:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788744195.542545:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788744195.542559:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788744195.542572:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788744195.542584:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788744195.542591:0:6511:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788744195.542615:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788744195.542623:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788744195.542634:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788744195.542647:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788744195.542661:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788744195.542669:0:6511:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788744195.542691:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788744195.542697:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788744195.542707:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788744195.542720:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788744195.543817:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788744195.543852:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788744195.543859:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788744195.544437:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788744195.544625:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788744195.544647:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:0.0:1788744195.544649:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788744195.544665:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788744195.544672:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788744195.544685:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788744195.544691:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788744195.544703:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788744195.544710:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788744195.544723:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788744195.544737:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788744195.544776:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788744195.544780:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788744195.544783:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788744195.544840:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788744195.544842:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788744195.545470:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788744195.545626:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788744195.545648:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788744195.545663:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788744195.545674:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788744195.545676:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788744195.545994:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788744195.546159:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788744195.546179:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788744195.546194:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788744195.546204:0:6511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744195.546206:0:6511:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788744195.546211:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788744195.546213:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788744195.546217:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788744195.546222:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788744195.550546:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788744195.550684:0:6511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788744195.558759:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788744195.558797:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788744195.558816:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788744195.558835:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788744195.558856:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558872:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558882:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558888:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558894:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558900:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558906:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6baf30d already unused, calling callback (000000004550dd54) 00010000:00010000:1.0:1788744195.558916:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558923:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558935:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558941:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.558946:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f6baf30d/0xb6207a6e76dcbcac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744195.558963:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788744195.574782:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af10923c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6493:x1875634154373376:12345-0@lo:253: Request processed in 68328us (68908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.574803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744195.574926:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ac4e6a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373376:0@lo:253: 10000000:01000000:3.0:1788744195.574941:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744195.574944:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744195.574946:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744195.574947:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744195.574948:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788744195.574949:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744195.574951:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744195.574952:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744195.574953:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744195.574955:0:6493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788744195.574956:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744195.574958:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744195.574977:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc6ef5af from lustre-MDT0000 10000000:01000000:3.0:1788744195.575007:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788744195.575009:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744195.575014:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ac750753380 10000000:01000000:3.0:1788744195.575031:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744195.575050:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac750753380 from 1 10000000:01000000:3.0:1788744195.575053:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744195.575101:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.575112:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.575120:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744195.575138:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020b13854 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373504:0@lo:101: 00000100:00100000:3.0:1788744195.575172:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744195.575218:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abc812a1 going to sleep for 11 seconds 00000100:00100000:2.0:1788744195.575642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154373504 00000100:00100000:2.0:1788744195.575649:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154373504 00000100:00100000:2.0:1788744195.575687:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744195.575695:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005be96d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6493:x1875634154373504:12345-0@lo:101: 00010000:00010000:2.0:1788744195.575707:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744195.575719:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbcb3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.575738:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.575747:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.575767:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000800a2585, rc 0) 00000100:00100000:2.0:1788744195.575966:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005be96d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+6:6493:x1875634154373504:12345-0@lo:101: Request processed in 271us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744195.575973:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744195.576384:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020b13854 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373504:0@lo:101: 00010000:00010000:1.0:1788744195.576426:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.576435:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744195.576492:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373632:0@lo:501: 00000100:00100000:1.0:1788744195.576522:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.576554:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c805a6d7 going to sleep for 11 seconds 00000100:00100000:2.0:1788744195.576680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154373632 00000100:00100000:2.0:1788744195.576685:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154373632 00000100:00100000:2.0:1788744195.576716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744195.576722:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bae55910 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+6:6493:x1875634154373632:12345-0@lo:501: 00000100:00100000:2.0:1788744195.576806:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bae55910 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+6:6493:x1875634154373632:12345-0@lo:501: Request processed in 84us (284us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744195.576819:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744195.577133:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373632:0@lo:501: 10000000:01000000:1.0:1788744195.577176:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788744195.577196:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577204:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744195.577212:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac75196e800 10000000:01000000:1.0:1788744195.577216:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788744195.577219:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ac75196e800 10000000:01000000:1.0:1788744195.577221:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788744195.577223:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ac75196e800 from 1 10000000:01000000:1.0:1788744195.577225:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788744195.577255:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577262:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577270:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744195.577282:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373760:0@lo:101: 00000100:00100000:1.0:1788744195.577307:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.577331:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c805a6d7 going to sleep for 11 seconds 00000100:00100000:0.0:1788744195.577389:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154373760 00000100:00100000:0.0:1788744195.577395:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154373760 00000100:00100000:0.0:1788744195.577441:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744195.577447:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a81463b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+6:6493:x1875634154373760:12345-0@lo:101: 00010000:00010000:0.0:1788744195.577456:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744195.577467:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000384b3ded/0xb6207a6e76dcbcc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbcc1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.577482:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000384b3ded/0xb6207a6e76dcbcc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbcc1 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.577489:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000384b3ded/0xb6207a6e76dcbcc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbcc1 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.577495:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000384b3ded, rc 0) 00000100:00100000:0.0:1788744195.577543:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a81463b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+7:6493:x1875634154373760:12345-0@lo:101: Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744195.577550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744195.577661:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373760:0@lo:101: 00010000:00010000:1.0:1788744195.577671:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577688:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744195.577698:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788744195.577701:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577707:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000f6baf30d/0xb6207a6e76dcbcc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744195.577712:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788744195.577715:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744195.577718:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ac75196e800 10000000:01000000:1.0:1788744195.577721:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788744195.577724:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788744195.577725:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788744195.577737:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577743:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577749:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744195.577769:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373888:0@lo:101: 00000100:00100000:1.0:1788744195.577794:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.577824:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c805a6d7 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.577839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154373888 00000100:00100000:1.0:1788744195.577842:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154373888 00000100:00100000:1.0:1788744195.577863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744195.577867:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aed4c726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+7:6493:x1875634154373888:12345-0@lo:101: 00010000:00010000:1.0:1788744195.577871:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744195.577876:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbccf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577884:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577889:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577893:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e976603d, rc 0) 00000100:00100000:1.0:1788744195.577912:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aed4c726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+8:6493:x1875634154373888:12345-0@lo:101: Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.577916:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744195.577931:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154373888:0@lo:101: 00010000:00010000:1.0:1788744195.577937:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.577941:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744195.577968:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374016:0@lo:501: 00000100:00100000:1.0:1788744195.577982:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.577986:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c805a6d7 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.577998:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374016 00000100:00100000:1.0:1788744195.578004:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374016 00000100:00100000:1.0:1788744195.578021:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744195.578024:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6f0c911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+8:6493:x1875634154374016:12345-0@lo:501: 00000100:00100000:1.0:1788744195.578372:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6f0c911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6493:x1875634154374016:12345-0@lo:501: Request processed in 345us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.578379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744195.579469:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374016:0@lo:501: 00000100:00100000:1.0:1788744195.579591:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374144:0@lo:503: 00000100:00100000:1.0:1788744195.579644:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.579988:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000add96c78 going to sleep for 11 seconds 00000100:00100000:3.0:1788744195.580191:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374144 00000100:00100000:3.0:1788744195.580197:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374144 00000100:00100000:3.0:1788744195.580252:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744195.580260:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8967ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6493:x1875634154374144:12345-0@lo:503: 00000100:00100000:3.0:1788744195.580354:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8967ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6493:x1875634154374144:12345-0@lo:503: Request processed in 96us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744195.580362:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744195.581011:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374144:0@lo:503: 00000100:00100000:1.0:1788744195.581394:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6537:1875634154374272:0@lo:502: 00000100:00100000:1.0:1788744195.581571:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.581602:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064f720a6 going to sleep for 11 seconds 00000100:00100000:2.0:1788744195.581712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374272 00000100:00100000:2.0:1788744195.581718:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374272 00000100:00100000:2.0:1788744195.581854:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744195.581862:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb5ad0e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6537:x1875634154374272:12345-0@lo:502: 00000100:00100000:2.0:1788744195.581954:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb5ad0e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6537:x1875634154374272:12345-0@lo:502: Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744195.581961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744195.582020:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e114230 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6537:1875634154374272:0@lo:502: 00000020:01000000:1.0:1788744195.582036:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744195.582053:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744195.582056:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788744195.582062:0:6537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788744195.582065:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744195.582078:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000031a585c8) 00000020:00000080:1.0:1788744195.582094:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788744195.582099:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788744195.582177:0:6537:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788744195.582188:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbce4 00000020:00000080:1.0:1788744195.582388:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788744195.582393:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744195.582396:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744195.582398:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788744195.582438:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744195.582453:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744195.582455:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788744195.582459:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744195.582466:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000025773914) 00000020:00000080:1.0:1788744195.582476:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788744195.582479:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788744195.582481:0:6537:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788744195.582484:0:6537:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788744195.582490:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788744195.582544:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc6ef5af from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788744195.582557:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000a5500bd) 00000020:00000080:1.0:1788744195.582565:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788744195.582631:0:6537:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788744195.582637:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcbcf9 00000020:00000080:1.0:1788744195.582972:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788744195.582979:0:6537:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788744195.582984:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb6207a6e76dcbd00 00080000:01000000:1.0:1788744195.582988:0:6537:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788744195.582991:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbd07 00080000:10000000:1.0:1788744195.583784:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788744195.583929:0:6537:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788744195.590020:0:6537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788744195.689329:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788744195.689661:0:6537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788744195.691942:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788744195.692316:0:6537:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788744195.694659:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002082971e) 00000020:00000080:3.0:1788744195.694678:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788744195.694767:0:6537:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788744195.694778:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbd15 00000020:00000080:2.0:1788744195.695438:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788744195.696831:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788744195.702943:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.706376:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.715874:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.735465:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.738692:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788744195.742906:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb6207a6e76dcbd1c 00000020:00000080:2.0:1788744195.760316:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788744195.760331:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744195.760337:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744195.760339:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788744195.760353:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744195.760357:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744195.760358:0:6537:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744195.760361:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744195.760363:0:6537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788744195.760366:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744195.760368:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744195.760369:0:6537:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788744195.760371:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744195.760375:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744195.760376:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788744195.760379:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788744195.760448:0:6537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788744195.760504:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0a2523a pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6537:1875634154374400:0@lo:502: 00000100:00100000:2.0:1788744195.760581:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.760628:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea61bbe4 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.761979:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374400 00000100:00100000:1.0:1788744195.761991:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374400 00000100:00100000:1.0:1788744195.762174:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744195.762184:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0260211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6537:x1875634154374400:12345-0@lo:502: 00000100:00100000:1.0:1788744195.762348:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0260211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6537:x1875634154374400:12345-0@lo:502: Request processed in 165us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.762356:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744195.764458:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0a2523a pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6537:1875634154374400:0@lo:502: 00000020:01000000:3.0:1788744195.764505:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744195.764515:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744195.764518:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788744195.764522:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788744195.765819:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788744195.766162:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744195.766183:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.766196:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744195.766205:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75196e800 from 1 10000000:01000000:2.0:1788744195.766208:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744195.766259:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.766266:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.766294:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744195.766316:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374528:0@lo:101: 00000100:00100000:2.0:1788744195.766379:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.766423:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a2bd5e9 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.767297:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374528 00000100:00100000:1.0:1788744195.767318:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374528 00000100:00100000:1.0:1788744195.767374:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744195.767382:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e970f9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6493:x1875634154374528:12345-0@lo:101: 00010000:00010000:1.0:1788744195.767397:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744195.767438:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbd23 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.767461:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.767472:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744195.767480:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2557e98, rc 0) 00000100:00100000:1.0:1788744195.767535:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e970f9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+10:6493:x1875634154374528:12345-0@lo:101: Request processed in 155us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.767542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744195.767768:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374528:0@lo:101: 00010000:00010000:2.0:1788744195.767783:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.767790:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744195.770628:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374656:0@lo:256: 00000100:00100000:2.0:1788744195.770698:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.770747:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a2bd5e9 going to sleep for 11 seconds 00000100:00100000:0.0:1788744195.772069:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374656 00000100:00100000:0.0:1788744195.772082:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374656 00000100:00100000:0.0:1788744195.772234:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744195.772255:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e41f99f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+10:6493:x1875634154374656:12345-0@lo:256: 20000000:01000000:0.0:1788744195.773554:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788744195.773565:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788744195.773751:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e41f99f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+10:6493:x1875634154374656:12345-0@lo:256: Request processed in 1495us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744195.773762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744195.773996:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374656:0@lo:256: 10000000:01000000:2.0:1788744195.775141:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744195.775251:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.775263:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744195.775271:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75196e800 from 1 10000000:01000000:2.0:1788744195.775273:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744195.775316:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.775323:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.775331:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744195.775348:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374784:0@lo:101: 00000100:00100000:2.0:1788744195.775529:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.775571:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a2bd5e9 going to sleep for 11 seconds 00000100:00100000:3.0:1788744195.775716:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374784 00000100:00100000:3.0:1788744195.775725:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374784 00000100:00100000:3.0:1788744195.775759:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744195.775766:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000724e84f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+10:6493:x1875634154374784:12345-0@lo:101: 00010000:00010000:3.0:1788744195.775778:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744195.775791:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbd31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.775813:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.775835:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.775844:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f86eacee, rc 0) 00000100:00100000:3.0:1788744195.775890:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000724e84f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6493:x1875634154374784:12345-0@lo:101: Request processed in 124us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744195.775896:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744195.776770:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374784:0@lo:101: 00010000:00010000:2.0:1788744195.776788:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.776798:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744195.777115:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374912:0@lo:501: 00000100:00100000:2.0:1788744195.777162:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.777191:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a2bd5e9 going to sleep for 11 seconds 00000100:00100000:0.0:1788744195.777292:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154374912 00000100:00100000:0.0:1788744195.777313:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154374912 00000100:00100000:2.0:1788744195.777883:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744195.777892:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077b1d4cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6493:x1875634154374912:12345-0@lo:501: 00000100:00100000:2.0:1788744195.778280:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077b1d4cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6493:x1875634154374912:12345-0@lo:501: Request processed in 389us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744195.778290:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744195.779070:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000043ea542 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154374912:0@lo:501: 00000100:00100000:3.0:1788744195.779329:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375040:0@lo:503: 00000100:00100000:3.0:1788744195.779393:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744195.779461:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be772b12 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.779647:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375040 00000100:00100000:1.0:1788744195.779654:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375040 00000100:00100000:1.0:1788744195.779700:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744195.779707:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b34b2681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6493:x1875634154375040:12345-0@lo:503: 00000040:00080000:1.0:1788744195.779749:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744195.779799:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b34b2681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6493:x1875634154375040:12345-0@lo:503: Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744195.779971:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375040:0@lo:503: 00000100:00100000:1.0:1788744195.780052:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:3.0:1788744195.782724:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788744195.782919:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788744195.782947:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744195.782969:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.782981:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744195.783029:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744195.783032:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac75196e800 10000000:01000000:2.0:1788744195.783034:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac75196e800 10000000:01000000:2.0:1788744195.783038:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744195.783043:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac75196e800 from 1 10000000:01000000:2.0:1788744195.783045:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744195.783075:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.783082:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.783092:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744195.783112:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9453d4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375168:0@lo:101: 00000100:00100000:2.0:1788744195.783172:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.783216:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a2bd5e9 going to sleep for 11 seconds 00000100:00100000:0.0:1788744195.783315:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375168 00000100:00100000:0.0:1788744195.783322:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375168 00000100:00100000:0.0:1788744195.783366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744195.783374:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098c6505a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6493:x1875634154375168:12345-0@lo:101: 00010000:00010000:0.0:1788744195.783387:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744195.783397:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbd3f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.783480:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.783490:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.783498:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078c7711a, rc 0) 00000100:00100000:0.0:1788744195.783620:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098c6505a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6493:x1875634154375168:12345-0@lo:101: Request processed in 246us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744195.783696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744195.783768:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9453d4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375168:0@lo:101: 00010000:00010000:3.0:1788744195.783782:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.783790:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744195.783940:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375296:0@lo:501: 00000100:00100000:3.0:1788744195.783968:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744195.784685:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000838eca64 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.785194:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375296 00000100:00100000:1.0:1788744195.785202:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375296 00000100:00100000:1.0:1788744195.785259:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744195.785267:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb0c0f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6493:x1875634154375296:12345-0@lo:501: 00000100:00100000:1.0:1788744195.785424:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb0c0f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6493:x1875634154375296:12345-0@lo:501: Request processed in 158us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.785433:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744195.785484:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375296:0@lo:501: 00000100:00100000:3.0:1788744195.785520:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375424:0@lo:503: 00000100:00100000:3.0:1788744195.785559:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744195.785575:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000838eca64 going to sleep for 11 seconds 00000100:00100000:0.0:1788744195.785626:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375424 00000100:00100000:0.0:1788744195.785631:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375424 00000100:00100000:0.0:1788744195.785694:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744195.785700:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af5224e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6493:x1875634154375424:12345-0@lo:503: 00000100:00100000:0.0:1788744195.785776:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af5224e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6493:x1875634154375424:12345-0@lo:503: Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744195.785783:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744195.785850:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375424:0@lo:503: 00000100:00100000:2.0:1788744195.786727:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000668b3453 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6542:1875634154375552:0@lo:502: 00000100:00100000:2.0:1788744195.786768:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744195.786835:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a2bd5e9 going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.786922:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375552 00000100:00100000:1.0:1788744195.786927:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375552 00000100:00100000:1.0:1788744195.787220:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744195.787228:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7818cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6542:x1875634154375552:12345-0@lo:502: 00000100:00100000:1.0:1788744195.787335:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7818cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6542:x1875634154375552:12345-0@lo:502: Request processed in 109us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744195.787341:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744195.787427:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000668b3453 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6542:1875634154375552:0@lo:502: 00000020:01000004:3.0:1788744195.787480:0:6542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788744195.787493:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000002e2d6b1) 00000020:00000080:3.0:1788744195.787511:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788744195.787590:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc6ef5af from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744195.787594:0:6542:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bc6ef5af from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744195.787596:0:6542:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bc6ef5af 4 00010000:00080000:3.0:1788744195.787621:0:6542:0:(ldlm_lib.c:103:import_set_conn()) imp 000000000e79c19a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744195.789439:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788744195.789708:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788744195.789744:0:6542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744195.789756:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb6207a6e76dcbd54 00000100:00080000:3.0:1788744195.789764:0:6542:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744195.789772:0:6542:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000e79c19a using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744195.789802:0:6542:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000af9e3506 x1875634154375680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744195.790007:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154375680:0@lo:38: 00000100:00100000:1.0:1788744195.790068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744195.790846:0:6542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744195.792552:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375680 00000100:00100000:0.0:1788744195.792562:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375680 00000100:00100000:0.0:1788744195.792602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744195.792610:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e114230 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154375680:12345-0@lo:38: 00000100:00100000:0.0:1788744195.792808:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e114230 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154375680:12345-0@lo:38: Request processed in 197us (2739us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788744195.792815:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744195.793234:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004152c77b pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6542:1875634154375808:0@lo:502: 00000100:00100000:0.0:1788744195.793299:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744195.793326:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 000000001633f9f9 going to sleep for 11 seconds 00000100:00100000:0.0:1788744195.793342:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375808 00000100:00100000:0.0:1788744195.793346:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375808 00000100:00100000:0.0:1788744195.793374:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744195.793381:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001db5bdea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6542:x1875634154375808:12345-0@lo:502: 00000100:00100000:0.0:1788744195.793502:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001db5bdea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6542:x1875634154375808:12345-0@lo:502: Request processed in 121us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744195.793510:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744195.793556:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004152c77b pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:6542:1875634154375808:0@lo:502: 00000040:00080000:0.0:1788744195.793580:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788744195.793737:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788744195.793758:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744195.793778:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.793788:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744195.793917:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744195.793924:0:3642:0:(import.c:65:import_set_state_nolock()) 000000000e79c19a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744195.793928:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788744195.793931:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af9e3506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154375680:0@lo:38: 00000020:01000004:3.0:1788744195.794451:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788744195.794453:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744195.794454:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744195.794456:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744195.794457:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744195.794458:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744195.794460:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744195.794461:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744195.794462:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744195.794463:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744195.794465:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744195.794467:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744195.794470:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788744195.794472:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744195.794474:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744195.794475:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744195.794476:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744195.794483:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744195.794484:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744195.794485:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744195.794486:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744195.794486:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744195.794487:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744195.794488:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744195.794489:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744195.794505:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744195.794514:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adabbf2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375936:0@lo:253: 00000100:00100000:3.0:1788744195.794551:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744195.794574:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000005672aaac going to sleep for 11 seconds 00000100:00100000:1.0:1788744195.797964:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154375936 00000100:00100000:1.0:1788744195.797978:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154375936 00000100:00100000:1.0:1788744195.798511:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744195.798523:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054841de8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6493:x1875634154375936:12345-0@lo:253: 20000000:01000000:1.0:1788744195.798560:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788744195.798572:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788744195.806879:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788744195.806899:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788744195.807025:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744195.807033:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744195.807052:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807070:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807078:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807115:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807141:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744195.807157:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004152c77b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154376064:0@lo:104: 00000100:00100000:0.0:1788744195.807219:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744195.807278:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013591377 going to sleep for 11 seconds 00000100:00100000:3.0:1788744195.807318:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376064 00000100:00100000:3.0:1788744195.807327:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376064 00000100:00100000:3.0:1788744195.807367:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744195.807376:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b21613f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154376064:12345-0@lo:104: 00010000:00010000:3.0:1788744195.807387:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744195.807481:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744195.807488:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b21613f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154376064:12345-0@lo:104: Request processed in 112us (269us total) trans 0 rc 0/0 00010000:00010000:0.0:1788744195.807489:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744195.807497:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744195.807501:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788744195.807514:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001ccdc63d already unused, calling callback (00000000be122ac2) 10000000:00010000:0.0:1788744195.807518:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807525:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744195.807531:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744195.807536:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744195.807572:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807579:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744195.807603:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807609:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd2a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.807631:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744195.807632:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744195.807634:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744195.807760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000835b8e95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154376192:0@lo:103: 00000100:00100000:3.0:1788744195.807790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744195.807921:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004152c77b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154376064:0@lo:104: 00010000:00010000:1.0:1788744195.807939:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744195.807994:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376192 00000100:00100000:0.0:1788744195.807999:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376192 00000100:00100000:2.0:1788744195.808025:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054841de8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6493:x1875634154375936:12345-0@lo:253: Request processed in 9505us (13472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744195.808042:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788744195.808081:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744195.808169:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adabbf2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:6493:1875634154375936:0@lo:253: 10000000:01000000:3.0:1788744195.808179:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744195.808182:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744195.808183:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744195.808185:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744195.808186:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744195.808187:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744195.808194:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744195.808195:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744195.808196:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744195.808197:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744195.808198:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744195.808200:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744195.808201:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788744195.808214:0:6493:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788744195.808353:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744195.808362:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b057db1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:3644:x1875634154376192:12345-0@lo:103: 00010000:00010000:0.0:1788744195.808374:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744195.808378:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808387:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808426:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c2557e98/0xb6207a6e76dcbd2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbd23 expref: 12 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808438:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808446:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788744195.808457:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001428640s 00010000:00010000:0.0:1788744195.808461:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808476:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808482:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808488:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808493:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021edfc10 already unused, calling callback (000000004550dd54) 00010000:00010000:0.0:1788744195.808496:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808503:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808519:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744195.808528:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744195.808560:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b057db1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:3644:x1875634154376192:12345-0@lo:103: Request processed in 200us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744195.808566:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788744195.808678:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.808685:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744195.808691:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbd5b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744195.814671:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000835b8e95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154376192:0@lo:103: 00080000:10000000:3.0:1788744195.814720:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.814909:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788744195.815158:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.815325:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788744195.815536:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788744195.815696:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788744195.817713:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788744195.817879:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788744195.818281:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788744195.818478:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788744195.820419:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788744195.820631:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788744195.825392:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788744195.837837:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788744195.838064:0:6547:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788744195.838069:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788744195.838318:0:6548:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788744195.842007:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788744195.842248:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788744195.842744:0:6493:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788744195.842751:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788744195.842846:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744195.847637:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788744195.848345:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788744195.848383:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788744195.848867:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788744195.849120:0:6493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788744195.850209:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788744195.850495:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788744195.850662:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788744195.850793:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788744195.850926:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788744195.851314:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788744195.851588:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788744195.851720:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788744195.851855:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788744195.852005:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000040:00080000:1.0:1788744195.852250:0:6548:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1788744195.852566:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788744195.854865:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788744195.855200:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788744195.855344:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788744195.855561:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788744195.855862:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788744195.856119:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788744195.856273:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788744195.856449:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788744195.856572:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788744195.856804:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788744195.856933:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788744195.857046:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788744195.857180:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788744195.857372:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788744195.857555:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788744195.857752:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:1.0:1788744195.857753:0:6548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788744195.857827:0:6548:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788744195.857832:0:6548:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788744195.857890:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788744195.858015:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788744195.858167:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788744195.858367:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788744195.858549:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788744195.858795:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788744195.862369:0:6493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788744195.862438:0:6493:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7f901a07988 00100000:10000000:2.0:1788744195.862445:0:6493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788744195.863293:0:6493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744195.863308:0:6493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744195.863326:0:6493:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788744195.863343:0:6493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788744195.864704:0:6493:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744195.864870:0:6493:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788744196.464698:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744197.492947:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744198.515017:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744199.534619:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744200.233819:0:6793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788744200.558694:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788744201.062357:0:6845:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744201.062685:0:6845:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1788744201.074421:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788744201.074430:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744201.074433:0:475:0:(import.c:65:import_set_state_nolock()) 000000000e79c19a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744201.074448:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000e79c19a using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744201.074467:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000159932f9 x1875634154376448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744201.074662:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000159932f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154376448:0@lo:38: 00000100:00100000:1.0:1788744201.074724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744201.074858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376448 00000100:00100000:0.0:1788744201.074866:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376448 00000100:00100000:0.0:1788744201.074904:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744201.074910:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca304705 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154376448:12345-0@lo:38: 00010000:00080000:0.0:1788744201.074933:0:6517:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:0.0:1788744201.074979:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb6207a6e76dcbd62 00000004:00100000:0.0:1788744201.075028:0:6517:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744201.075151:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000a7e05086 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744201.075199:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca304705 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875634154376448:12345-0@lo:38: Request processed in 288us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744201.075217:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788744201.075252:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000159932f9 x1875634154376448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744201.075276:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788744201.075282:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788744201.075286:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744201.075288:0:3642:0:(import.c:65:import_set_state_nolock()) 000000000e79c19a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744201.075292:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000159932f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154376448:0@lo:38: 00000100:00100000:3.0:1788744201.076647:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000835b8e95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154376320:0@lo:400: 00000100:00100000:3.0:1788744201.076701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744201.077323:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376320 00000100:00100000:2.0:1788744201.077331:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376320 00000100:00100000:2.0:1788744201.077490:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744201.077499:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee655150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+11:3645:x1875634154376320:12345-0@lo:400: 00000100:00100000:2.0:1788744201.077561:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee655150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+11:3645:x1875634154376320:12345-0@lo:400: Request processed in 64us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744201.077568:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744201.077918:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000835b8e95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154376320:0@lo:400: 00010000:00010000:0.0:1788744201.582862:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744202.608346:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744203.630571:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788744204.112093:0:6947:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744204.112268:0:6947:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788744204.654497:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744204.654505:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75196e800 from 3 10000000:01000000:3.0:1788744204.654510:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744204.654552:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744204.654565:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744204.654575:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744204.654610:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adabbf2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154376576:0@lo:101: 00000100:00100000:3.0:1788744204.654676:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744204.654733:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ced198e4 going to sleep for 11 seconds 00010000:00010000:3.0:1788744204.656158:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744204.656235:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376576 00000100:00100000:2.0:1788744204.656245:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376576 00000100:00100000:2.0:1788744204.656305:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744204.656315:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c6288a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6513:x1875634154376576:12345-0@lo:101: 00010000:00010000:2.0:1788744204.656330:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744204.656348:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbd69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744204.656371:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744204.656381:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744204.656427:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f167a0c, rc 0) 00000100:00100000:2.0:1788744204.656489:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c6288a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154376576:12345-0@lo:101: Request processed in 175us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744204.656496:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744204.656618:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adabbf2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154376576:0@lo:101: 00010000:00010000:0.0:1788744204.656636:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744204.656645:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744204.656697:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000159932f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154376704:0@lo:256: 00000100:00100000:0.0:1788744204.656732:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744204.656756:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a953b1a going to sleep for 11 seconds 00000100:00100000:0.0:1788744204.656770:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376704 00000100:00100000:0.0:1788744204.656774:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376704 00000100:00100000:0.0:1788744204.656798:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744204.656804:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004df55c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154376704:12345-0@lo:256: 20000000:01000000:0.0:1788744204.656817:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744204.656831:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744204.656834:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788744204.656908:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004df55c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154376704:12345-0@lo:256: Request processed in 103us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744204.656923:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744204.656953:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000159932f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154376704:0@lo:256: 10000000:01000000:0.0:1788744204.657154:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744204.657161:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744204.657168:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744205.678592:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744206.192519:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081c50acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154376960:0@lo:400: 00000100:00100000:1.0:1788744206.192589:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744206.192667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376960 00000100:00100000:1.0:1788744206.192675:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376960 00000100:00100000:1.0:1788744206.192718:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744206.192726:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ee8d839 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154376960:12345-0@lo:400: 00000100:00100000:1.0:1788744206.192773:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ee8d839 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154376960:12345-0@lo:400: Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744206.192781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788744206.192817:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000081c50acf x1875634154376960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744206.192832:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081c50acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154376960:0@lo:400: 00000100:00100000:3.0:1788744206.192901:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744206.192911:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef9c27d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154376832:0@lo:400: 00000100:00100000:3.0:1788744206.192941:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744206.193306:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154376832 00000100:00100000:1.0:1788744206.193312:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154376832 00000100:00100000:1.0:1788744206.193380:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744206.193387:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c434a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:3645:x1875634154376832:12345-0@lo:400: 00000100:00100000:1.0:1788744206.193463:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c434a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:3645:x1875634154376832:12345-0@lo:400: Request processed in 77us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744206.193470:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744206.193542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef9c27d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154376832:0@lo:400: 00010000:00010000:0.0:1788744206.703490:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744207.731539:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744208.751528:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744209.774780:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744210.799683:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744211.312047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f067728f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154377088:0@lo:400: 00000100:00100000:1.0:1788744211.312120:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744211.312236:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377088 00000100:00100000:2.0:1788744211.312244:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377088 00000100:00100000:2.0:1788744211.312298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744211.312306:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d713057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+12:3644:x1875634154377088:12345-0@lo:400: 00000100:00100000:3.0:1788744211.312542:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ba55c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154377216:0@lo:400: 00000100:00100000:3.0:1788744211.312605:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744211.312677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377216 00000100:00100000:3.0:1788744211.312682:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377216 00000100:00100000:3.0:1788744211.312723:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744211.312729:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065cb0332 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154377216:12345-0@lo:400: 00000100:00100000:3.0:1788744211.312768:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065cb0332 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154377216:12345-0@lo:400: Request processed in 40us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744211.312774:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744211.312814:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000ba55c01 x1875634154377216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744211.312825:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ba55c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154377216:0@lo:400: 00000100:00100000:2.0:1788744211.313258:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d713057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+12:3644:x1875634154377088:12345-0@lo:400: Request processed in 890us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744211.313266:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744211.313377:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f067728f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154377088:0@lo:400: 00010000:00010000:1.0:1788744211.822593:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744212.846574:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788744213.011231:0:7445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788744213.011235:0:7445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788744213.011236:0:7445:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788744213.011350:0:7445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000019f4a1b 00000020:01000004:0.0:1788744213.011365:0:7445:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788744213.011375:0:7445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788744213.011388:0:7445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000005d9af6c) 00000020:00000080:0.0:1788744213.011443:0:7445:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788744213.053221:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788744213.053300:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788744213.075985:0:7445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788744213.076335:0:7445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788744213.076345:0:7445:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744213.076356:0:7445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcbd7e 00000020:01000004:2.0:1788744213.076363:0:7445:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788744213.076383:0:7445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744213.076387:0:7445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744213.076392:0:7445:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788744213.076441:0:7445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788744213.076446:0:7445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788744213.099524:0:7445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744213.099634:0:7445:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788744213.099639:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744213.099641:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744213.099642:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744213.099649:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744213.099650:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744213.099651:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744213.099653:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744213.099654:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744213.099655:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744213.099657:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744213.099658:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744213.099661:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788744213.099663:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744213.099664:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744213.099665:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744213.099666:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744213.099667:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744213.099667:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744213.099668:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744213.099669:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744213.099670:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744213.099671:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744213.099671:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744213.099696:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788744213.099713:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154377344:0@lo:253: 00000100:00100000:2.0:1788744213.099779:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.099862:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0a68ca7 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.099904:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377344 00000100:00100000:1.0:1788744213.099912:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377344 00000100:00100000:1.0:1788744213.100104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744213.100114:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba790e83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154377344:12345-0@lo:253: 20000000:01000000:1.0:1788744213.100154:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788744213.100159:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788744213.100164:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788744213.100167:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788744213.100202:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788744213.100392:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744213.101146:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788744213.101161:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788744213.101178:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788744213.101194:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788744213.101210:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788744213.101272:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788744213.101280:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788744213.101297:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788744213.101303:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788744213.101316:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788744213.101329:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788744213.101346:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788744213.101366:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788744213.101743:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788744213.101754:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:1.0:1788744213.101768:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788744213.101774:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788744213.101789:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788744213.101795:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:1.0:1788744213.101807:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788744213.101813:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788744213.101828:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788744213.101846:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788744213.101857:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788744213.102119:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788744213.102141:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788744213.102156:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788744213.102172:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788744213.102188:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788744213.102195:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788744213.102208:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788744213.102227:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788744213.102232:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788744213.102252:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788744213.102258:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788744213.102862:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788744213.103199:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788744213.103219:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:1.0:1788744213.103221:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:1.0:1788744213.103236:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788744213.103242:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788744213.103265:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788744213.103272:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:1.0:1788744213.103288:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788744213.103296:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788744213.103310:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788744213.103325:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788744213.103464:0:6510:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788744213.103476:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788744213.104233:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788744213.104473:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788744213.104497:0:6510:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:2.0:1788744213.104500:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:2.0:1788744213.104517:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788744213.104524:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788744213.104538:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788744213.104546:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:2.0:1788744213.104559:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788744213.104566:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788744213.104579:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788744213.104595:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788744213.104623:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788744213.104626:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788744213.104629:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788744213.104672:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788744213.104674:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744213.105345:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744213.105370:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744213.105381:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788744213.105717:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788744213.105740:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788744213.105760:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788744213.105772:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788744213.105775:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744213.106355:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744213.106387:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744213.106466:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788744213.106629:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788744213.106646:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788744213.106718:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788744213.106732:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788744213.106733:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744213.107392:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744213.107508:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744213.107525:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788744213.109732:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788744213.109768:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788744213.109785:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788744213.109799:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788744213.109801:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788744213.109806:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788744213.109812:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788744213.110311:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788744213.110815:0:6510:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788744213.121246:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788744213.121376:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121427:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121458:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121466:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121472:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121515:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121528:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 12 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744213.121543:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ba55c01 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154377472:0@lo:104: 00000100:00100000:3.0:1788744213.121622:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744213.121696:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121705:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 12 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744213.121713:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000187185d3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154377600:0@lo:104: 00000100:00100000:3.0:1788744213.121736:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744213.121768:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.121782:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 12 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744213.121797:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4b8b036 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154377728:0@lo:104: 00000100:00100000:3.0:1788744213.121820:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744213.121830:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4deef8c going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.122092:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377472 00000100:00100000:1.0:1788744213.122100:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377472 00000100:00100000:1.0:1788744213.122149:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377600 00000100:00100000:1.0:1788744213.122152:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377600 00000100:00100000:1.0:1788744213.122163:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377728 00000100:00100000:1.0:1788744213.122165:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377728 00000100:00100000:1.0:1788744213.122177:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744213.122185:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053ae2041 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6510:x1875634154377472:12345-0@lo:104: 00010000:00010000:1.0:1788744213.122196:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122272:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744213.122277:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053ae2041 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6510:x1875634154377472:12345-0@lo:104: Request processed in 94us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.122285:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744213.122304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.122310:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9b4ac2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6510:x1875634154377600:12345-0@lo:104: 00010000:00010000:1.0:1788744213.122317:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122350:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744213.122355:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9b4ac2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6510:x1875634154377600:12345-0@lo:104: Request processed in 46us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.122371:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.122385:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744213.122390:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d411c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6510:x1875634154377728:12345-0@lo:104: 00010000:00010000:1.0:1788744213.122397:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122447:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788744213.122452:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d411c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6510:x1875634154377728:12345-0@lo:104: Request processed in 63us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.122458:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788744213.122474:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744213.122480:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122487:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004aa7e8ae already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744213.122491:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122500:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744213.122507:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.122512:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744213.122539:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122545:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744213.122570:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122576:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbd3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd46 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122588:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744213.122591:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122596:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000eabd40b already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744213.122599:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122605:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744213.122610:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.122616:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744213.122628:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122634:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744213.122646:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122653:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000000eabd40b/0xb6207a6e76dcbccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbcd6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122661:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744213.122670:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122676:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000053c3d5c already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744213.122678:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122685:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744213.122690:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.122695:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744213.122707:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122714:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744213.122718:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122724:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000053c3d5c/0xb6207a6e76dcbcb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbcba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.122737:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744213.122739:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744213.122741:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744213.122749:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744213.122759:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081c50acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154377856:0@lo:103: 00000100:00100000:1.0:1788744213.122789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.122822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154378112:0@lo:103: 00000100:00100000:1.0:1788744213.122852:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.122871:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744213.122876:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d7386bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154377984:0@lo:103: 00000100:00100000:1.0:1788744213.122895:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.122919:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377856 00000100:00100000:1.0:1788744213.122924:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377856 00010000:00010000:1.0:1788744213.122940:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 13 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.122956:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378112 00000100:00100000:1.0:1788744213.122958:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378112 00010000:00010000:1.0:1788744213.122967:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 14 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.122977:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154377984 00000100:00100000:1.0:1788744213.122980:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154377984 00010000:00010000:1.0:1788744213.122989:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 15 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.123001:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744213.123006:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000143cb29f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3645:x1875634154377856:12345-0@lo:103: 00010000:00010000:1.0:1788744213.123016:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744213.123020:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123029:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123042:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744213.123068:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000143cb29f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3645:x1875634154377856:12345-0@lo:103: Request processed in 63us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.123081:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744213.123094:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.123100:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083784812 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3644:x1875634154378112:12345-0@lo:103: 00010000:00010000:1.0:1788744213.123107:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744213.123110:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 14 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123117:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 14 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123139:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744213.123165:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083784812 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3644:x1875634154378112:12345-0@lo:103: Request processed in 66us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.123171:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.123182:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744213.123187:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6818c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:3644:x1875634154377984:12345-0@lo:103: 00010000:00010000:1.0:1788744213.123194:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744213.123197:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 13 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123204:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 13 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123214:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123221:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123244:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123250:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123256:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123261:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123266:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d4d92ac3 already unused, calling callback (000000004550dd54) 00010000:00010000:1.0:1788744213.123269:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123275:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123282:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.123290:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744213.123311:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6818c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:3644:x1875634154377984:12345-0@lo:103: Request processed in 124us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.123317:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744213.123351:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081c50acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154377856:0@lo:103: 00000100:00100000:1.0:1788744213.123373:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d7386bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154377984:0@lo:103: 00000100:00100000:1.0:1788744213.123379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154378112:0@lo:103: 00010000:00010000:1.0:1788744213.123447:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744213.123591:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078c7711a/0xb6207a6e76dcbd46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbd3f expref: 12 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744213.123602:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ba55c01 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154377472:0@lo:104: 00010000:00010000:3.0:1788744213.123610:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e976603d/0xb6207a6e76dcbcd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbccf expref: 11 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744213.123616:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000187185d3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154377600:0@lo:104: 00010000:00010000:3.0:1788744213.123622:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbcba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbcb3 expref: 10 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744213.123629:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4b8b036 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154377728:0@lo:104: 00010000:00010000:3.0:1788744213.123648:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.123655:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.123660:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.123664:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744213.123678:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788744213.129254:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba790e83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+9:7445:x1875634154377344:12345-0@lo:253: Request processed in 29133us (29466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.129282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744213.129525:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154377344:0@lo:253: 10000000:01000000:2.0:1788744213.129544:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788744213.129547:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744213.129549:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744213.129550:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744213.129551:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788744213.129561:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744213.129563:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744213.129564:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744213.129565:0:7445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788744213.129567:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744213.129568:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744213.129590:0:7445:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000019f4a1b from lustre-MDT0001 10000000:01000000:2.0:1788744213.129621:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788744213.129624:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788744213.129630:0:7445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac750753380 local copy 10000000:01000000:2.0:1788744213.129633:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744213.129667:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.129678:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.129687:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.129705:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378240:0@lo:101: 00000100:00100000:2.0:1788744213.129740:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.129950:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cf123c8 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.129996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378240 00000100:00100000:3.0:1788744213.130003:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378240 00000100:00100000:3.0:1788744213.130082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744213.130091:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c135795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+9:7445:x1875634154378240:12345-0@lo:101: 00010000:00010000:3.0:1788744213.130104:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744213.130135:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbd8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.130157:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd8c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.130168:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd8c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.130176:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4d92ac3, rc 0) 00000100:00100000:3.0:1788744213.130216:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c135795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+10:7445:x1875634154378240:12345-0@lo:101: Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.130223:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744213.130288:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378240:0@lo:101: 00010000:00010000:2.0:1788744213.130301:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.130309:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.130389:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378368:0@lo:501: 00000100:00100000:2.0:1788744213.130450:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.132693:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cf123c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788744213.134985:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378368 00000100:00100000:0.0:1788744213.134999:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378368 00000100:00100000:0.0:1788744213.135965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744213.135978:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d97ad3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+10:7445:x1875634154378368:12345-0@lo:501: 00000100:00100000:0.0:1788744213.137152:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d97ad3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+10:7445:x1875634154378368:12345-0@lo:501: Request processed in 1172us (6697us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744213.137165:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744213.141777:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378368:0@lo:501: 10000000:01000000:2.0:1788744213.141810:0:7445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744213.141854:0:7445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744213.141874:0:7445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.141887:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.141894:0:7445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.141918:0:7445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744213.141945:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac774b65800 10000000:01000000:2.0:1788744213.141951:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744213.141956:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ac750753380 10000000:01000000:2.0:1788744213.141959:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788744213.141962:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ac750753380 from 1 10000000:01000000:2.0:1788744213.141964:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788744213.141999:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.142007:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.142017:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.142018:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744213.142028:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.142039:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001ccdc63d already unused, calling callback (00000000be122ac2) 00000100:00100000:2.0:1788744213.142043:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378496:0@lo:101: 10000000:00010000:1.0:1788744213.142043:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.142053:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744213.142067:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.142073:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744213.142096:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.142103:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744213.142142:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.142148:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000001ccdc63d/0xb6207a6e76dcbd8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcbd93 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.142164:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744213.142166:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744213.142167:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744213.142175:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744213.142188:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154378624:0@lo:103: 00000100:00100000:1.0:1788744213.142233:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.142326:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378624 00000100:00100000:0.0:1788744213.142335:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378624 00000100:00100000:0.0:1788744213.142390:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744213.142441:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d7386bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+10:3646:x1875634154378624:12345-0@lo:103: 00010000:00010000:0.0:1788744213.142456:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744213.142470:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4d92ac3/0xb6207a6e76dcbd93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcbd8c expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.142496:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744213.142535:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d7386bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+9:3646:x1875634154378624:12345-0@lo:103: Request processed in 136us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.142543:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744213.142634:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154378624:0@lo:103: 00000100:00100000:2.0:1788744213.142635:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.142673:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.142698:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378496 00000100:00100000:3.0:1788744213.142704:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378496 00000100:00100000:3.0:1788744213.142745:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744213.142752:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0f7c1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:7445:x1875634154378496:12345-0@lo:101: 00010000:00010000:3.0:1788744213.142765:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744213.142777:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc6c896b/0xb6207a6e76dcbda1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbd9a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.144565:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc6c896b/0xb6207a6e76dcbda1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd9a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.144582:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc6c896b/0xb6207a6e76dcbda1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd9a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.144591:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc6c896b, rc 0) 00000100:00100000:3.0:1788744213.144677:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0f7c1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+10:7445:x1875634154378496:12345-0@lo:101: Request processed in 1925us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.144686:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744213.144849:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378496:0@lo:101: 00010000:00010000:2.0:1788744213.144870:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.144881:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744213.144902:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788744213.144922:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.144930:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000bfe11c87/0xb6207a6e76dcbd9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744213.144941:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ac774b65800 10000000:01000000:2.0:1788744213.144946:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788744213.144952:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ac774b65800 from 1 10000000:01000000:2.0:1788744213.144955:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788744213.144982:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.144989:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.144997:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.145015:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378752:0@lo:101: 00000100:00100000:2.0:1788744213.145069:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.145106:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.145159:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378752 00000100:00100000:1.0:1788744213.145166:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378752 00000100:00100000:1.0:1788744213.145215:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744213.145223:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2406247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+10:7445:x1875634154378752:12345-0@lo:101: 00010000:00010000:1.0:1788744213.145235:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744213.145246:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000eabd40b/0xb6207a6e76dcbdaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbda8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.145261:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000eabd40b/0xb6207a6e76dcbdaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbda8 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.145268:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000eabd40b/0xb6207a6e76dcbdaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbda8 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.145476:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000eabd40b, rc 0) 00000100:00100000:1.0:1788744213.145518:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2406247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+11:7445:x1875634154378752:12345-0@lo:101: Request processed in 296us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.145524:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744213.145562:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378752:0@lo:101: 00010000:00010000:2.0:1788744213.145573:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.145580:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744213.145592:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788744213.145607:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.145614:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000d3303f78/0xb6207a6e76dcbda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744213.145620:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788744213.145624:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744213.145629:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ac774b65800 10000000:01000000:2.0:1788744213.145632:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788744213.145635:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788744213.145637:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788744213.145652:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.145659:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.145665:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.145683:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378880:0@lo:101: 00000100:00100000:2.0:1788744213.145710:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.145737:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.145879:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154378880 00000100:00100000:3.0:1788744213.145886:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154378880 00000100:00100000:3.0:1788744213.145919:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744213.145999:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000279de0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:7445:x1875634154378880:12345-0@lo:101: 00010000:00010000:3.0:1788744213.146007:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744213.146017:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005544ee38/0xb6207a6e76dcbdbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbdb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.146030:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005544ee38/0xb6207a6e76dcbdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.146037:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005544ee38/0xb6207a6e76dcbdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.146042:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005544ee38, rc 0) 00000100:00100000:3.0:1788744213.146078:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000279de0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154378880:12345-0@lo:101: Request processed in 154us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.146084:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744213.146220:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154378880:0@lo:101: 00010000:00010000:2.0:1788744213.146232:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.146239:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.146320:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379008:0@lo:501: 00000100:00100000:2.0:1788744213.146347:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.146369:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.146392:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379008 00000100:00100000:1.0:1788744213.146398:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379008 00000100:00100000:1.0:1788744213.146448:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744213.146455:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058790f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379008:12345-0@lo:501: 00000100:00100000:1.0:1788744213.146556:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058790f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379008:12345-0@lo:501: Request processed in 102us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.146563:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744213.146657:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379008:0@lo:501: 00000100:00100000:2.0:1788744213.146684:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379136:0@lo:503: 00000100:00100000:2.0:1788744213.146720:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.146748:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.146874:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379136 00000100:00100000:3.0:1788744213.146880:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379136 00000100:00100000:3.0:1788744213.146909:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744213.146915:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a64fde4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379136:12345-0@lo:503: 00000100:00100000:3.0:1788744213.147093:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a64fde4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379136:12345-0@lo:503: Request processed in 178us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.147100:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744213.147221:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379136:0@lo:503: 00000040:00080000:2.0:1788744213.147543:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744213.147638:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379264:0@lo:502: 00000100:00100000:2.0:1788744213.147683:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.147720:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.147885:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379264 00000100:00100000:1.0:1788744213.147897:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379264 00000100:00100000:1.0:1788744213.148017:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744213.148027:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca0e94b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379264:12345-0@lo:502: 00000100:00100000:1.0:1788744213.148135:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca0e94b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379264:12345-0@lo:502: Request processed in 101us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.148144:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788744213.148237:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379264:0@lo:502: 00000040:00080000:2.0:1788744213.148471:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788744213.148507:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788744213.148522:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788744213.148534:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788744213.148547:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788744213.148560:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788744213.148573:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788744213.148587:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788744213.148600:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788744213.148613:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788744213.148626:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788744213.148653:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788744213.148669:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788744213.148681:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788744213.148693:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788744213.148705:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788744213.148716:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788744213.148728:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788744213.148742:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788744213.148755:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788744213.148768:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788744213.148781:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788744213.148794:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788744213.148819:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379392:0@lo:502: 00000100:00100000:2.0:1788744213.148874:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.148908:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5ba3668 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.149041:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379392 00000100:00100000:3.0:1788744213.149048:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379392 00000100:00100000:3.0:1788744213.149089:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744213.149096:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8721b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379392:12345-0@lo:502: 00000100:00100000:3.0:1788744213.149216:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8721b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379392:12345-0@lo:502: Request processed in 120us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.149224:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744213.149313:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005256aab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379392:0@lo:502: 00000040:00080000:0.0:1788744213.149365:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788744213.149374:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788744213.150231:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744213.150244:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744213.150247:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788744213.150252:0:7457:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788744213.150256:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744213.150270:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000016ad49c5) 00000020:00000080:0.0:1788744213.150289:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788744213.150293:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788744213.150381:0:7457:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744213.150388:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcbdcb 00000020:00000080:0.0:1788744213.150664:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788744213.150668:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744213.150672:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744213.150673:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788744213.150675:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744213.150679:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744213.150680:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788744213.150683:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744213.150698:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000792e73d) 00000020:00000080:0.0:1788744213.150709:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788744213.150714:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788744213.150715:0:7457:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788744213.150718:0:7457:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788744213.150723:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744213.150772:0:7457:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000019f4a1b from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788744213.150783:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000ba5d1a76) 00000020:00000080:0.0:1788744213.150792:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788744213.150844:0:7457:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788744213.150849:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcbde0 00000020:00000080:0.0:1788744213.150949:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788744213.150956:0:7457:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788744213.150960:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb6207a6e76dcbde7 00080000:01000000:0.0:1788744213.150964:0:7457:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788744213.150973:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcbdee 00080000:10000000:0.0:1788744213.151498:0:7457:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788744213.151610:0:7457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788744213.252999:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788744213.253876:0:7457:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788744213.258241:0:7457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788744213.258650:0:7457:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788744213.278456:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788744213.278470:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744213.278482:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744213.278484:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788744213.278488:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744213.278492:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744213.278494:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788744213.278496:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744213.278501:0:7457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:2.0:1788744213.278524:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744213.278536:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000029c264c9) 00000020:00000080:2.0:1788744213.278573:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788744213.278581:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744213.278661:0:7457:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788744213.278668:0:7457:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788744213.278674:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcbdfc 00010000:00080000:2.0:1788744213.278713:0:7457:0:(ldlm_lib.c:103:import_set_conn()) imp 000000003c9dce1e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788744213.287330:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788744213.294951:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744213.294969:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788744213.295010:0:7457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788744213.295577:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcbe03 00000100:00080000:3.0:1788744213.295588:0:7457:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744213.295600:0:7457:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000003c9dce1e using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744213.295644:0:7457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4b8b036 x1875634154379520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744213.295792:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744213.295986:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4b8b036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154379520:0@lo:38: 00000100:00100000:0.0:1788744213.296300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788744213.296506:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744213.296511:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744213.296514:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788744213.296518:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788744213.296520:0:7457:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788744213.296528:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744213.296530:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744213.296532:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788744213.296535:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744213.296536:0:7457:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788744213.296539:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744213.296543:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744213.296545:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788744213.296549:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788744213.297225:0:7457:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788744213.297250:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744213.297254:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744213.297255:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788744213.297258:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744213.297261:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744213.297262:0:7457:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744213.297265:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744213.297267:0:7457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788744213.297294:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744213.297297:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744213.297298:0:7457:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744213.297301:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788744213.298107:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788744213.298155:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788744213.298178:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.298191:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000004aa7e8ae/0xb6207a6e76dcbdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744213.298199:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac774b65800 from 1 10000000:01000000:0.0:1788744213.298202:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744213.298236:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.298244:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.298255:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744213.298275:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c506629b pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379648:0@lo:101: 00000100:00100000:0.0:1788744213.298328:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.298365:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dac6ea8 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.298689:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379648 00000100:00100000:1.0:1788744213.298903:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379520 00000100:00100000:1.0:1788744213.298908:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379520 00000100:00100000:3.0:1788744213.299003:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379648 00000100:00100000:1.0:1788744213.299233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744213.299241:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000159932f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875634154379520:12345-0@lo:38: 00010000:00080000:1.0:1788744213.299265:0:6520:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1788744213.299297:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcbe11 00000004:00100000:1.0:1788744213.299311:0:6520:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788744213.299316:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788744213.299461:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744213.299472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154379776:0@lo:400: 00000100:00100000:1.0:1788744213.299535:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.299583:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379776 00000100:00100000:1.0:1788744213.299588:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379776 00000100:00100000:1.0:1788744213.299616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.299623:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081c50acf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154379776:12345-0@lo:400: 00000100:00100000:1.0:1788744213.299664:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081c50acf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154379776:12345-0@lo:400: Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.299671:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744213.300467:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744213.300479:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b17337bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:7445:x1875634154379648:12345-0@lo:101: 00010000:00010000:3.0:1788744213.300492:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744213.300507:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe0a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.300530:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.300558:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.300567:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b07d83c, rc 0) 00000100:00100000:3.0:1788744213.300616:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b17337bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7445:x1875634154379648:12345-0@lo:101: Request processed in 141us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.300622:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788744213.300838:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004fada6cd x1875634154379776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744213.300852:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154379776:0@lo:400: 00000100:00100000:1.0:1788744213.301858:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c506629b pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379648:0@lo:101: 00010000:00010000:1.0:1788744213.301879:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.301890:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.302754:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379904:0@lo:256: 00000100:00100000:1.0:1788744213.302823:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.303157:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bdbb76e going to sleep for 11 seconds 00000100:00080000:1.0:1788744213.305247:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000118ae47e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744213.305339:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000159932f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875634154379520:12345-0@lo:38: Request processed in 6096us (9038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.305351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744213.305435:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154379904 00000100:00100000:0.0:1788744213.305444:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154379904 00000100:00100000:0.0:1788744213.305482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744213.305496:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5813610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7445:x1875634154379904:12345-0@lo:256: 20000000:01000000:0.0:1788744213.305515:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788744213.305530:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788744213.305534:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788744213.305632:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5813610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7445:x1875634154379904:12345-0@lo:256: Request processed in 137us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.305639:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744213.305685:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744213.305694:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788744213.305827:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788744213.305834:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744213.305836:0:3642:0:(import.c:65:import_set_state_nolock()) 000000003c9dce1e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744213.305850:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4b8b036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154379520:0@lo:38: 00000100:00100000:1.0:1788744213.305962:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154379904:0@lo:256: 10000000:01000000:1.0:1788744213.306815:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744213.306840:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.306852:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.306861:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac774b65800 from 1 10000000:01000000:1.0:1788744213.306864:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744213.306894:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.306902:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.307717:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.307737:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380032:0@lo:101: 00000100:00100000:1.0:1788744213.307788:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.307819:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bdbb76e going to sleep for 11 seconds 00000100:00100000:0.0:1788744213.307903:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380032 00000100:00100000:0.0:1788744213.307911:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380032 00000100:00100000:0.0:1788744213.307957:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744213.307964:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000117631bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7445:x1875634154380032:12345-0@lo:101: 00010000:00010000:0.0:1788744213.307977:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744213.307988:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe1f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.308008:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.308026:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.308033:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021edfc10, rc 0) 00000100:00100000:0.0:1788744213.308081:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000117631bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7445:x1875634154380032:12345-0@lo:101: Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.308088:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744213.308376:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380032:0@lo:101: 00010000:00010000:1.0:1788744213.308389:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.308397:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.308519:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380160:0@lo:501: 00000100:00100000:1.0:1788744213.308546:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.308562:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bdbb76e going to sleep for 11 seconds 00000100:00100000:0.0:1788744213.308686:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380160 00000100:00100000:0.0:1788744213.308691:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380160 00000100:00100000:0.0:1788744213.308710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744213.308716:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d33412f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7445:x1875634154380160:12345-0@lo:501: 00000100:00100000:0.0:1788744213.308809:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d33412f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7445:x1875634154380160:12345-0@lo:501: Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.308816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744213.309077:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380160:0@lo:501: 00000100:00100000:1.0:1788744213.309107:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380288:0@lo:503: 00000100:00100000:1.0:1788744213.309156:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.309181:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bdbb76e going to sleep for 11 seconds 00000100:00100000:0.0:1788744213.309227:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380288 00000100:00100000:0.0:1788744213.309231:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380288 00000100:00100000:0.0:1788744213.309260:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744213.309265:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a63d08dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7445:x1875634154380288:12345-0@lo:503: 00000040:00080000:0.0:1788744213.309295:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744213.309339:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a63d08dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7445:x1875634154380288:12345-0@lo:503: Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.309345:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744213.309435:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fada6cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380288:0@lo:503: 00000040:00080000:1.0:1788744213.309772:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744213.309816:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788744213.309889:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744213.310501:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026108340 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154380416:0@lo:41: 00000100:00100000:1.0:1788744213.310551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.310700:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380416 00000100:00100000:2.0:1788744213.310706:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380416 00000100:00100000:2.0:1788744213.310742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744213.310750:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fada6cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154380416:12345-0@lo:41: 00000004:00000024:2.0:1788744213.310777:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788744213.310822:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fada6cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154380416:12345-0@lo:41: Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744213.310828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744213.310867:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026108340 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154380416:0@lo:41: 00000040:00080000:1.0:1788744213.312270:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788744213.312635:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788744213.312663:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744213.312682:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.312693:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744213.312746:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788744213.312749:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac774b65800 10000000:01000000:0.0:1788744213.312752:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac774b65800 10000000:01000000:0.0:1788744213.312768:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744213.312774:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac774b65800 from 1 10000000:01000000:0.0:1788744213.312776:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744213.312806:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.312813:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.312821:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744213.312840:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380544:0@lo:101: 00000100:00100000:0.0:1788744213.312891:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.312973:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000003686bce6 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.313184:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380544 00000100:00100000:3.0:1788744213.313191:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380544 00000100:00100000:3.0:1788744213.313264:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744213.313271:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a0f3249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7445:x1875634154380544:12345-0@lo:101: 00010000:00010000:3.0:1788744213.313283:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744213.313294:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1904222/0xb6207a6e76dcbe34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe2d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.313313:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1904222/0xb6207a6e76dcbe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.313322:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1904222/0xb6207a6e76dcbe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744213.313331:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1904222, rc 0) 00000100:00100000:3.0:1788744213.313373:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a0f3249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380544:12345-0@lo:101: Request processed in 103us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.313379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744213.313499:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380544:0@lo:101: 00010000:00010000:0.0:1788744213.313512:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.313518:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744213.313609:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380672:0@lo:501: 00000100:00100000:0.0:1788744213.313633:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.314093:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000003686bce6 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.314202:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380672 00000100:00100000:1.0:1788744213.314207:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380672 00000100:00100000:1.0:1788744213.314231:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744213.314237:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009eb86cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380672:12345-0@lo:501: 00000100:00100000:1.0:1788744213.314339:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009eb86cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380672:12345-0@lo:501: Request processed in 102us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.314346:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744213.314437:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380672:0@lo:501: 00000100:00100000:0.0:1788744213.314465:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380800:0@lo:503: 00000100:00100000:0.0:1788744213.314505:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.314528:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000003686bce6 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.314642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380800 00000100:00100000:1.0:1788744213.314646:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380800 00000100:00100000:1.0:1788744213.314661:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788744213.314666:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004cb66a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380800:12345-0@lo:503: 00000100:00100000:1.0:1788744213.314742:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004cb66a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380800:12345-0@lo:503: Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.314748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744213.314820:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380800:0@lo:503: 00000040:00080000:0.0:1788744213.315217:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744213.315287:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380928:0@lo:502: 00000100:00100000:0.0:1788744213.315322:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.315435:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000003686bce6 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.315558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154380928 00000100:00100000:3.0:1788744213.315664:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154380928 00000100:00100000:3.0:1788744213.315691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744213.315704:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a763f20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380928:12345-0@lo:502: 00000100:00100000:3.0:1788744213.315805:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a763f20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154380928:12345-0@lo:502: Request processed in 102us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.315812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744213.315891:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154380928:0@lo:502: 00000040:00080000:0.0:1788744213.316216:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788744213.316244:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788744213.316259:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788744213.316271:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788744213.316283:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788744213.316295:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788744213.316306:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788744213.316318:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788744213.316331:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788744213.316343:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788744213.316354:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788744213.316365:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788744213.316377:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788744213.316390:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788744213.316432:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788744213.316463:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788744213.316479:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788744213.316491:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788744213.316504:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788744213.316516:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788744213.316529:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788744213.316542:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788744213.316556:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788744213.316581:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788744213.316606:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788744213.316619:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788744213.316631:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788744213.316642:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788744213.316669:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154381056:0@lo:502: 00000100:00100000:0.0:1788744213.316710:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.316738:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000003686bce6 going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.316898:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381056 00000100:00100000:3.0:1788744213.316904:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381056 00000100:00100000:3.0:1788744213.316937:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744213.316943:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051a16df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154381056:12345-0@lo:502: 00000100:00100000:3.0:1788744213.317144:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051a16df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154381056:12345-0@lo:502: Request processed in 201us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.317152:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788744213.317315:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154381056:0@lo:502: 00000040:00080000:0.0:1788744213.317352:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788744213.317359:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788744213.318300:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788744213.318316:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000e334b6aa) 00000020:00000080:2.0:1788744213.318334:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788744213.318593:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000019f4a1b from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788744213.318598:0:7463:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000019f4a1b from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788744213.318605:0:7463:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000019f4a1b 3 00010000:00080000:2.0:1788744213.318628:0:7463:0:(ldlm_lib.c:103:import_set_conn()) imp 0000000072375965@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788744213.320840:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788744213.325253:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788744213.325295:0:7463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788744213.325320:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb6207a6e76dcbe42 00000100:00080000:2.0:1788744213.325330:0:7463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744213.325340:0:7463:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000072375965 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744213.325374:0:7463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026108340 x1875634154381184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744213.325424:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788744213.326014:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744213.326087:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022777dda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154381312:0@lo:400: 00000100:00100000:1.0:1788744213.326156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.326201:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f857844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154381440:0@lo:400: 00000100:00100000:1.0:1788744213.326229:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.326249:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744213.326254:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096d34fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154381568:0@lo:400: 00000100:00100000:1.0:1788744213.326278:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.326309:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381440 00000100:00100000:1.0:1788744213.326316:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381440 00000100:00100000:1.0:1788744213.326353:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744213.326369:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4290f4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154381440:12345-0@lo:400: 00000100:00100000:1.0:1788744213.326437:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4290f4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154381440:12345-0@lo:400: Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.326445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744213.326465:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381568 00000100:00100000:1.0:1788744213.326468:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381568 00000100:00100000:1.0:1788744213.326490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.326496:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013acab92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875634154381568:12345-0@lo:400: 00000100:00100000:1.0:1788744213.326526:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013acab92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875634154381568:12345-0@lo:400: Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.326531:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744213.327467:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026108340 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154381184:0@lo:38: 00000100:00100000:3.0:1788744213.327512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744213.327555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381312 00000100:00100000:3.0:1788744213.327627:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381312 00000100:00100000:3.0:1788744213.327664:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744213.327671:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f0b8a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154381312:12345-0@lo:400: 00000100:00100000:3.0:1788744213.327710:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f0b8a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154381312:12345-0@lo:400: Request processed in 40us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.327716:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744213.327892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096d34fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154381568:0@lo:400: 00010000:00080000:1.0:1788744213.327911:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009f857844 x1875634154381440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744213.327921:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f857844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154381440:0@lo:400: 00000040:00080000:3.0:1788744213.328159:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788744213.328285:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788744213.328318:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744213.328331:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744213.328341:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000069b9b8b5/0xb6207a6e76dcbe2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788744213.328389:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788744213.328392:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788744213.328393:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744213.328394:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744213.328395:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744213.328397:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744213.328398:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788744213.328424:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744213.328426:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744213.328428:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744213.328429:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744213.328433:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788744213.328435:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788744213.328436:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788744213.328438:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744213.328445:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744213.328445:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744213.328446:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744213.328447:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788744213.328448:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744213.328449:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744213.328450:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744213.328451:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744213.328469:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788744213.328480:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154381696:0@lo:253: 00000100:00100000:0.0:1788744213.328515:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.328533:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff43f04d going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.328672:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381184 00000100:00100000:1.0:1788744213.328677:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381184 00000100:00100000:1.0:1788744213.328699:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744213.328704:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000187185d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154381184:12345-0@lo:38: 00010000:00080000:1.0:1788744213.328722:0:6515:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788744213.328753:0:6515:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb6207a6e76dcbe49 00000004:00100000:1.0:1788744213.328765:0:6515:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744213.328793:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000063c59e1a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744213.328836:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000187185d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875634154381184:12345-0@lo:38: Request processed in 131us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.328843:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788744213.328888:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026108340 x1875634154381184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744213.328896:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744213.328902:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788744213.328908:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788744213.328912:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744213.328914:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000072375965 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744213.328919:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026108340 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154381184:0@lo:38: 00000100:00100000:3.0:1788744213.329674:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381696 00000100:00100000:3.0:1788744213.329681:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381696 00000100:00100000:3.0:1788744213.329712:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744213.329719:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066b0df02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154381696:12345-0@lo:253: 20000000:01000000:3.0:1788744213.329741:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788744213.329753:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:0.0:1788744213.330093:0:7465:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788744213.330621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022777dda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154381312:0@lo:400: 00000001:00100000:0.0:1788744213.332918:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788744213.333163:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744213.333205:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788744213.333697:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066b0df02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:7445:x1875634154381696:12345-0@lo:253: Request processed in 3974us (5178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.333719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744213.333864:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:7445:1875634154381696:0@lo:253: 10000000:01000000:0.0:1788744213.333878:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788744213.333881:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744213.333883:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788744213.333884:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744213.333885:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744213.333886:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744213.333888:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744213.333889:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788744213.333890:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744213.333892:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744213.333893:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744213.333895:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788744213.333909:0:7445:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788744213.339437:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 20000000:01000000:2.0:1788744213.339683:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744213.339689:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00080000:10000000:0.0:1788744213.339822:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788744213.340250:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:2.0:1788744213.340756:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.340774:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.340781:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.340787:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.340826:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.340839:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 14 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.340864:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006617d0e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154381824:0@lo:104: 00000100:00100000:2.0:1788744213.340999:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788744213.341193:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788744213.341451:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788744213.341699:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1788744213.342073:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.342085:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 14 pid: 6509 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.342094:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006609fb69 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154381952:0@lo:104: 00000100:00100000:2.0:1788744213.342139:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788744213.342392:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788744213.342676:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788744213.342862:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788744213.344349:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788744213.344653:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788744213.344834:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:2.0:1788744213.345994:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000633f9b1d going to sleep for 11 seconds 00000040:01000000:3.0:1788744213.347556:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788744213.347753:0:7468:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788744213.347758:0:7468:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788744213.347836:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788744213.347882:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003dd2e804 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875634154382080:0@lo:700: 00000040:01000000:3.0:1788744213.348021:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788744213.348224:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.348256:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064dddbaa going to sleep for 11 seconds 00000100:00100000:3.0:1788744213.348311:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382080 00000100:00100000:3.0:1788744213.348319:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382080 00000100:00100000:3.0:1788744213.348364:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744213.348372:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf4c09dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875634154382080:12345-0@lo:700: 00000100:00100000:1.0:1788744213.348646:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381824 00000100:00100000:1.0:1788744213.348652:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381824 00000100:00100000:1.0:1788744213.348676:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154381952 00000100:00100000:1.0:1788744213.348680:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154381952 00000100:00100000:1.0:1788744213.348693:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744213.348698:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000192a81c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6531:x1875634154381824:12345-0@lo:104: 00010000:00010000:1.0:1788744213.348712:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.348810:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744213.348816:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000192a81c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6531:x1875634154381824:12345-0@lo:104: Request processed in 118us (7818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.348823:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744213.348840:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744213.348846:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047ecd062 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154381952:12345-0@lo:104: 00010000:00010000:1.0:1788744213.348853:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.348887:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744213.348899:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047ecd062 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154381952:12345-0@lo:104: Request processed in 54us (6761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.348905:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788744213.348922:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744213.348935:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.348943:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7b32cf4 already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744213.348946:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.348955:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744213.348961:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.348966:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744213.348994:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349001:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744213.349145:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349153:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000d7b32cf4/0xb6207a6e76dcbe0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe18 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349164:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744213.349167:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349182:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046066250 already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744213.349184:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349190:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744213.349195:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744213.349199:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744213.349212:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349217:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744213.349221:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349227:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 0000000046066250/0xb6207a6e76dcbd69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349240:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744213.349241:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744213.349243:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744213.349260:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f857844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154382208:0@lo:103: 00000100:00100000:1.0:1788744213.349291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.349319:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744213.349324:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096d34fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154382336:0@lo:103: 00000100:00100000:1.0:1788744213.349360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744213.349389:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382208 00000100:00100000:1.0:1788744213.349393:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382208 00010000:00010000:1.0:1788744213.349432:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 15 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.349452:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382336 00000100:00100000:1.0:1788744213.349455:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382336 00010000:00010000:1.0:1788744213.349466:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 16 pid: 6509 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744213.349478:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744213.349483:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc02bc7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3643:x1875634154382208:12345-0@lo:103: 00010000:00010000:1.0:1788744213.349493:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744213.349497:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 16 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349506:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 16 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349521:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744213.349547:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc02bc7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3643:x1875634154382208:12345-0@lo:103: Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.349554:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744213.349578:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744213.349583:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1e81c4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154382336:12345-0@lo:103: 00010000:00010000:1.0:1788744213.349590:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744213.349594:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 15 pid: 6509 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349611:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 15 pid: 6509 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349621:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349629:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744213.349642:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009954347s 00010000:00010000:1.0:1788744213.349646:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349652:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349658:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349663:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349668:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000800a2585 already unused, calling callback (000000004550dd54) 00010000:00010000:1.0:1788744213.349671:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349677:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349684:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744213.349705:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744213.349727:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1e81c4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154382336:12345-0@lo:103: Request processed in 145us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.349734:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744213.349792:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096d34fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154382336:0@lo:103: 00000100:00100000:1.0:1788744213.349801:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f857844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154382208:0@lo:103: 00000100:00100000:0.0:1788744213.350278:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154382464:0@lo:1000: 00000100:00100000:0.0:1788744213.350313:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.350329:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a484607 going to sleep for 11 seconds 00000100:00100000:1.0:1788744213.350372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382464 00000100:00100000:1.0:1788744213.350377:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382464 00000100:00100000:1.0:1788744213.350431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744213.350438:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003af83bee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154382464:12345-0@lo:1000: 00000100:00100000:1.0:1788744213.350501:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003af83bee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154382464:12345-0@lo:1000: Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744213.350507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744213.350661:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154382464:0@lo:1000: 00000040:01000000:0.0:1788744213.350682:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788744213.350705:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154382592:0@lo:700: 00000100:00100000:0.0:1788744213.350730:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.350756:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382592 00000100:00100000:0.0:1788744213.350760:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382592 00000100:00100000:0.0:1788744213.350786:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744213.350792:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b295592e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154382592:12345-0@lo:700: 00000100:00100000:0.0:1788744213.350826:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b295592e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154382592:12345-0@lo:700: Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.350833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744213.350850:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bca03857 going to sleep for 11 seconds 00000100:00100000:0.0:1788744213.350862:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154382592:0@lo:700: 00000100:00100000:0.0:1788744213.350895:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875634154382720:0@lo:900: 00000100:00100000:0.0:1788744213.350921:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.351095:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382720 00000100:00100000:0.0:1788744213.351104:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382720 00000100:00100000:0.0:1788744213.351138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744213.351144:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df5807d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875634154382720:12345-0@lo:900: 00000100:00100000:0.0:1788744213.351179:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df5807d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875634154382720:12345-0@lo:900: Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.351184:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744213.351202:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bca03857 going to sleep for 11 seconds 00010000:00080000:0.0:1788744213.351213:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007d9759d3 x1875634154382720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788744229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744213.351222:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875634154382720:0@lo:900: 00000100:00100000:0.0:1788744213.351268:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154382848:0@lo:1000: 00000100:00100000:0.0:1788744213.351291:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.351303:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000616ac9e3 going to sleep for 11 seconds 00000040:01000000:1.0:1788744213.351819:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788744213.351922:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1788744213.352098:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1788744213.352751:0:7445:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788744213.352760:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788744213.352904:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744213.353677:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154382848 00000100:00100000:0.0:1788744213.353688:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154382848 00000100:00100000:0.0:1788744213.353732:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744213.353740:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060b5ca83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154382848:12345-0@lo:1000: 00000100:00100000:0.0:1788744213.353833:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060b5ca83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154382848:12345-0@lo:1000: Request processed in 94us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.353840:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744213.353882:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154382848:0@lo:1000: 00000004:00080000:0.0:1788744213.353943:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000bca03857 with version 0 00000020:00100000:0.0:1788744213.353963:0:7470:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788744213.353968:0:7470:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007d9759d3 x1875634154383104/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744213.353986:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154383104:0@lo:1000: 00000100:00100000:0.0:1788744213.354139:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.354162:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154383104 00000100:00100000:0.0:1788744213.354166:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154383104 00000100:00100000:0.0:1788744213.354186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744213.354192:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000780793bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154383104:12345-0@lo:1000: 00000100:00100000:0.0:1788744213.354481:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062116bdb going to sleep for 11 seconds 40000000:02000000:3.0:1788744213.355814:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00010000:00010000:2.0:1788744213.357092:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b07d83c/0xb6207a6e76dcbe18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe0a expref: 14 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.357111:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006617d0e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154381824:0@lo:104: 00010000:00010000:2.0:1788744213.357137:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f167a0c/0xb6207a6e76dcbd70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbd69 expref: 13 pid: 6509 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744213.357146:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006609fb69 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154381952:0@lo:104: 00010000:00010000:2.0:1788744213.357171:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.357198:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.357204:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744213.357209:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000800a2585/0xb6207a6e76dcbe50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744213.358892:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788744213.359158:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000780793bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154383104:12345-0@lo:1000: Request processed in 4965us (5017us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788744213.359171:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1788744213.359218:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788744213.359223:0:7470:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788744213.359238:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154383104:0@lo:1000: 00000100:00100000:0.0:1788744213.359320:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154383232:0@lo:1000: 00000100:00100000:0.0:1788744213.359352:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.359379:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154383232 00000100:00100000:0.0:1788744213.359385:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154383232 00000040:00080000:1.0:1788744213.360198:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788744213.360680:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744213.360692:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005915fd41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154383232:12345-0@lo:1000: 00000100:00100000:0.0:1788744213.360774:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005915fd41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875634154383232:12345-0@lo:1000: Request processed in 86us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.360780:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744213.360807:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a484607 going to sleep for 11 seconds 00000100:00100000:0.0:1788744213.360826:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d9759d3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875634154383232:0@lo:1000: 00000040:00080000:0.0:1788744213.360846:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788744213.360880:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000bca03857 with version 1 00000004:00080000:2.0:1788744213.361684:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b09ba6fb version 1 rpc_version 1 00000020:00100000:2.0:1788744213.361714:0:7460:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788744213.361720:0:7460:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006609fb69 x1875634154383488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744213.361737:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006609fb69 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875634154383488:0@lo:1000: 00000100:00100000:2.0:1788744213.361782:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744213.361808:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000633f9b1d going to sleep for 11 seconds 00000040:00080000:1.0:1788744213.363328:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788744213.363428:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788744213.365498:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788744213.365782:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788744213.366893:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788744213.367249:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788744213.367438:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788744213.367648:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788744213.368007:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788744213.368362:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788744213.368514:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000040:00080000:0.0:1788744213.368556:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744213.368627:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788744213.368676:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154383488 00000100:00100000:0.0:1788744213.368685:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154383488 00000100:00100000:0.0:1788744213.368732:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744213.368740:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006617d0e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1875634154383488:12345-0@lo:1000: 00100000:10000000:1.0:1788744213.369832:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788744213.370625:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788744213.370978:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000100:00100000:3.0:1788744213.371331:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf4c09dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875634154382080:12345-0@lo:700: Request processed in 22956us (23103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744213.371343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1788744213.371922:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788744213.372770:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788744213.372976:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788744213.373153:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788744213.373286:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788744213.373455:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788744213.373777:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788744213.373912:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788744213.374091:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788744213.374256:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788744213.374398:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788744213.374580:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788744213.374711:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788744213.374855:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788744213.374989:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788744213.375120:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788744213.375274:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788744213.375474:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788744213.375616:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788744213.375745:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788744213.375879:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788744213.376024:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00010000:00080000:2.0:1788744213.376575:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003dd2e804 x1875634154382080/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744213.376593:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003dd2e804 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875634154382080:0@lo:700: 40000000:02000000:2.0:1788744213.376609:0:7469:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00000004:0.0:1788744213.379374:0:7445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788744213.379741:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788744213.379852:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006617d0e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1875634154383488:12345-0@lo:1000: Request processed in 11110us (18067us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788744213.379865:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1788744213.379912:0:7460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788744213.379917:0:7460:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788744213.379933:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006609fb69 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875634154383488:0@lo:1000: 00000001:00080000:0.0:1788744213.385997:0:7445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788744213.386150:0:7445:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa7f9017bf988 00100000:10000000:0.0:1788744213.386159:0:7445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788744213.386712:0:7445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744213.386746:0:7445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744213.386767:0:7445:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788744213.386784:0:7445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788744213.387563:0:7445:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744213.388097:0:7445:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788744213.426371:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744213.448258:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788744213.448335:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788744213.448340:0:7469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788744213.883482:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744214.894599:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744215.921587:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744216.942649:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744217.116294:0:7714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788744217.966715:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788744218.073967:0:7767:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744218.074159:0:7767:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788744218.480384:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083280680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154383872:0@lo:400: 00000100:00100000:3.0:1788744218.480426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154384000:0@lo:400: 00000100:00100000:1.0:1788744218.480498:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ba55c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154383616:0@lo:400: 00000100:00100000:0.0:1788744218.480581:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744218.480582:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744218.480582:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744218.480711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384000 00000100:00100000:3.0:1788744218.480721:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384000 00000100:00100000:0.0:1788744218.480721:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154383872 00000100:00100000:0.0:1788744218.480739:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154383872 00000100:00100000:3.0:1788744218.480771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744218.480792:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b44a34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154384000:12345-0@lo:400: 00000100:00100000:1.0:1788744218.480830:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003dd2e804 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154384128:0@lo:41: 00000100:00100000:3.0:1788744218.480858:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b44a34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154384000:12345-0@lo:400: Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744218.480866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744218.480887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384128 00000100:00100000:1.0:1788744218.480891:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744218.480893:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384128 00000100:00100000:1.0:1788744218.480899:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfeb616c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154383744:0@lo:400: 00000100:00100000:0.0:1788744218.480922:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744218.480927:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744218.480933:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d9759d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154383872:12345-0@lo:400: 00000100:00100000:1.0:1788744218.480965:0:6516:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788744218.480975:0:6516:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788744218.480987:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d9759d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154383872:12345-0@lo:400: Request processed in 58us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744218.480995:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744218.481012:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744218.481019:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f857844 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154384128:12345-0@lo:41: 00000004:00000024:0.0:1788744218.481041:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788744218.481081:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f857844 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154384128:12345-0@lo:41: Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744218.481100:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744218.481104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154383744 00000100:00100000:1.0:1788744218.481109:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154383744 00000100:00100000:1.0:1788744218.481139:0:6516:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788744218.481142:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003dd2e804 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154384128:0@lo:41: 00000100:00100000:1.0:1788744218.481149:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744218.481156:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000096d34fee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154383744:12345-0@lo:400: 00000100:00100000:0.0:1788744218.481180:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083280680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154383872:0@lo:400: 00000100:00100000:1.0:1788744218.481197:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000096d34fee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154383744:12345-0@lo:400: Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744218.481204:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788744218.481230:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bfeb616c x1875634154383744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744218.481241:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfeb616c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154383744:0@lo:400: 00000100:00100000:3.0:1788744218.481779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744218.481804:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154383616 00000100:00100000:3.0:1788744218.481811:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154383616 00000100:00100000:3.0:1788744218.481839:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744218.481846:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2699f0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:3645:x1875634154383616:12345-0@lo:400: 00000100:00100000:3.0:1788744218.481914:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2699f0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:3645:x1875634154383616:12345-0@lo:400: Request processed in 68us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744218.481923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744218.481932:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ba55c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154383616:0@lo:400: 00010000:00080000:3.0:1788744218.481967:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a31ee385 x1875634154384000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744218.481978:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154384000:0@lo:400: 00010000:00010000:3.0:1788744218.991234:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744220.021922:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788744220.663572:0:7869:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744220.663703:0:7869:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788744221.038801:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744221.697111:0:7917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff31f55880 20000000:00000080:2.0:1788744221.697129:0:7917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac775b6bc00 uarg=0000000000000000 20000000:01000000:2.0:1788744221.697167:0:7917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788744221.697175:0:7917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788744221.697179:0:7917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788744221.697254:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788744221.697264:0:7917:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788744221.701454:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744221.701712:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788744221.701745:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788744221.701765:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788744221.701781:0:7917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744221.701798:0:7917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744221.701817:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744221.701823:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744221.701829:0:7917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744221.701867:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744221.701949:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 12 pid: 6511 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744221.701962:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8a86b98 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875634154384256:0@lo:104: 00000100:00100000:2.0:1788744221.702024:0:7917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744221.702094:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744221.702101:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 12 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744221.702120:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000051b6f838 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875634154384384:0@lo:104: 00000100:00100000:2.0:1788744221.702138:0:7917:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015fd0f12 going to sleep for 11 seconds 00000100:00100000:0.0:1788744221.703432:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788744221.703465:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744221.703494:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384256 00000100:00100000:0.0:1788744221.703501:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384256 00000100:00100000:1.0:1788744221.703590:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384384 00000100:00100000:1.0:1788744221.703594:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384384 00000100:00100000:1.0:1788744221.703605:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744221.703610:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cac17dd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+4:7917:x1875634154384256:12345-0@lo:104: 00010000:00010000:1.0:1788744221.703623:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703694:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744221.703699:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cac17dd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+4:7917:x1875634154384256:12345-0@lo:104: Request processed in 89us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744221.703711:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744221.703768:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744221.703773:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b5dc481 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:7917:x1875634154384384:12345-0@lo:104: 00010000:00010000:1.0:1788744221.703782:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703811:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744221.703814:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b5dc481 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:7917:x1875634154384384:12345-0@lo:104: Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744221.703820:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788744221.703833:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744221.703837:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703854:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c6e07c2 already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744221.703857:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703865:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744221.703882:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744221.703888:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744221.703924:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703931:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744221.703948:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703957:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000004c6e07c2/0xb6207a6e76dcbe1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe26 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703970:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744221.703975:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703980:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000057393fa already unused, calling callback (00000000be122ac2) 10000000:00010000:1.0:1788744221.703982:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.703995:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744221.704000:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744221.704007:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744221.704018:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704023:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744221.704034:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704040:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000057393fa/0xb6207a6e76dcbd31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbd38 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704050:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744221.704052:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744221.704053:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744221.704057:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744221.704083:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000143cb29f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154384512:0@lo:103: 00000100:00100000:1.0:1788744221.704110:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744221.704145:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083784812 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154384640:0@lo:103: 00000100:00100000:1.0:1788744221.704162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744221.704184:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384512 00000100:00100000:1.0:1788744221.704188:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384512 00010000:00010000:1.0:1788744221.704201:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 13 pid: 6511 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744221.704232:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384640 00000100:00100000:1.0:1788744221.704235:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384640 00010000:00010000:1.0:1788744221.704243:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 14 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744221.704252:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744221.704256:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6818c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3646:x1875634154384512:12345-0@lo:103: 00010000:00010000:1.0:1788744221.704264:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744221.704268:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 14 pid: 6511 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704275:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 14 pid: 6511 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704287:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744221.704307:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6818c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3646:x1875634154384512:12345-0@lo:103: Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744221.704312:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744221.704322:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744221.704326:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d7386bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:3643:x1875634154384640:12345-0@lo:103: 00010000:00010000:1.0:1788744221.704331:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744221.704333:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 13 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704339:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 13 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704347:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704358:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704369:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704375:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704380:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704384:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704388:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c3654823 already unused, calling callback (000000004550dd54) 00010000:00010000:1.0:1788744221.704391:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704396:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704425:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744221.704432:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744221.704453:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d7386bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:3643:x1875634154384640:12345-0@lo:103: Request processed in 127us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744221.704458:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744221.704486:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083784812 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154384640:0@lo:103: 00000100:00100000:1.0:1788744221.704510:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000143cb29f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154384512:0@lo:103: 00010000:00010000:0.0:1788744221.704573:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000021edfc10/0xb6207a6e76dcbe26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe1f expref: 12 pid: 6511 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744221.704583:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8a86b98 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875634154384256:0@lo:104: 00010000:00010000:0.0:1788744221.704589:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f86eacee/0xb6207a6e76dcbd38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbd31 expref: 11 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744221.704595:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000051b6f838 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875634154384384:0@lo:104: 00010000:00010000:0.0:1788744221.704607:0:7917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744221.704613:0:7917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744221.704618:0:7917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744221.704622:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c3654823/0xb6207a6e76dcbe57 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.065513:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744222.576036:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788744222.576045:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac774b65800 from 4 10000000:01000000:2.0:1788744222.576050:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744222.576100:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.576113:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.576123:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.576144:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046934a9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154384768:0@lo:101: 00000100:00100000:2.0:1788744222.576206:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.576253:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000081f92fd9 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.576306:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384768 00000100:00100000:3.0:1788744222.576314:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384768 00000100:00100000:3.0:1788744222.576368:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744222.576376:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f191fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+11:6513:x1875634154384768:12345-0@lo:101: 00010000:00010000:3.0:1788744222.576389:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744222.576434:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3f47bc2/0xb6207a6e76dcbe65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe5e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.576468:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3f47bc2/0xb6207a6e76dcbe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.576477:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3f47bc2/0xb6207a6e76dcbe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.576485:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3f47bc2, rc 0) 00000100:00100000:3.0:1788744222.576524:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f191fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154384768:12345-0@lo:101: Request processed in 149us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.576530:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744222.579512:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046934a9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154384768:0@lo:101: 00010000:00010000:3.0:1788744222.579539:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.579550:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744222.579617:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154384896:0@lo:256: 00000100:00100000:3.0:1788744222.579672:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.579713:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006071411e going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.579792:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154384896 00000100:00100000:1.0:1788744222.579799:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154384896 00000100:00100000:1.0:1788744222.579837:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744222.579845:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000312a4d2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154384896:12345-0@lo:256: 20000000:01000000:1.0:1788744222.579874:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744222.579888:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744222.579892:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788744222.579963:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000312a4d2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154384896:12345-0@lo:256: Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.579970:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788744222.580108:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154384896:0@lo:256: 10000000:01000000:3.0:1788744222.580154:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744222.580160:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.580167:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000800a2585/0xb6207a6e76dcbe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744222.580180:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744222.580182:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac774b65800 from 1 10000000:01000000:3.0:1788744222.580184:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744222.580206:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000a97221ae/0xb6207a6e76dcbe6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.580212:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000a97221ae/0xb6207a6e76dcbe6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.580219:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000a97221ae/0xb6207a6e76dcbe6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744222.580229:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385024:0@lo:101: 00000100:00100000:3.0:1788744222.580251:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.580273:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006071411e going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.580319:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385024 00000100:00100000:1.0:1788744222.580324:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385024 00000100:00100000:1.0:1788744222.580354:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744222.580361:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077d78d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+12:6513:x1875634154385024:12345-0@lo:101: 00010000:00010000:1.0:1788744222.580368:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744222.580380:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007790851c/0xb6207a6e76dcbe73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe6c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.580398:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007790851c/0xb6207a6e76dcbe73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.580430:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007790851c/0xb6207a6e76dcbe73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.580438:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007790851c, rc 0) 00000100:00100000:1.0:1788744222.580465:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077d78d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6513:x1875634154385024:12345-0@lo:101: Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.580480:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788744222.580549:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385024:0@lo:101: 00010000:00010000:3.0:1788744222.580558:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000a97221ae/0xb6207a6e76dcbe6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.580564:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000a97221ae/0xb6207a6e76dcbe6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744222.580615:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385152:0@lo:501: 00000100:00100000:3.0:1788744222.580639:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.580664:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006071411e going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.581492:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385152 00000100:00100000:1.0:1788744222.581500:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385152 00000100:00100000:1.0:1788744222.581537:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788744222.581544:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a500356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6513:x1875634154385152:12345-0@lo:501: 00000100:00100000:1.0:1788744222.581657:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a500356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6513:x1875634154385152:12345-0@lo:501: Request processed in 113us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.581664:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744222.581736:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385152:0@lo:501: 00000100:00100000:3.0:1788744222.581770:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385280:0@lo:503: 00000100:00100000:3.0:1788744222.581814:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.581835:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006071411e going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.581882:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385280 00000100:00100000:1.0:1788744222.581888:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385280 00000100:00100000:1.0:1788744222.581916:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744222.581922:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d64b3697 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6513:x1875634154385280:12345-0@lo:503: 00000100:00100000:1.0:1788744222.581992:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d64b3697 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6513:x1875634154385280:12345-0@lo:503: Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.581998:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788744222.582269:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385280:0@lo:503: 00000100:00100000:3.0:1788744222.585378:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7966:1875634154385408:0@lo:502: 00000100:00100000:3.0:1788744222.585584:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.585618:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3c5f1f8 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.585678:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385408 00000100:00100000:1.0:1788744222.585686:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385408 00000100:00100000:1.0:1788744222.585734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788744222.585742:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd86f673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7966:x1875634154385408:12345-0@lo:502: 00000100:00100000:1.0:1788744222.585856:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd86f673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7966:x1875634154385408:12345-0@lo:502: Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.585875:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744222.586116:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a31ee385 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7966:1875634154385408:0@lo:502: 00000020:01000000:3.0:1788744222.586146:0:7966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744222.586156:0:7966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.586158:0:7966:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744222.586167:0:7966:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac774b65800 00000020:00000080:3.0:1788744222.586170:0:7966:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744222.586210:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7966:1875634154385536:0@lo:502: 00000100:00100000:3.0:1788744222.586245:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.586277:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.586962:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385536 00000100:00100000:1.0:1788744222.586969:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385536 00000100:00100000:1.0:1788744222.587002:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788744222.587009:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7966:x1875634154385536:12345-0@lo:502: 00000100:00100000:1.0:1788744222.587111:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:7966:x1875634154385536:12345-0@lo:502: Request processed in 102us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.587117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744222.590207:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7966:1875634154385536:0@lo:502: 00000020:01000000:3.0:1788744222.590253:0:7966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744222.590262:0:7966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.590264:0:7966:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788744222.590270:0:7966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788744222.590347:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788744222.590367:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744222.590377:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590388:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744222.590429:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744222.590432:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac75196e800 from 21 10000000:01000000:3.0:1788744222.590435:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744222.590467:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590474:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590481:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744222.590499:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385664:0@lo:101: 00000100:00100000:3.0:1788744222.590555:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.590586:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.590603:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385664 00000100:00100000:3.0:1788744222.590609:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385664 00000100:00100000:3.0:1788744222.590647:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744222.590655:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+13:6513:x1875634154385664:12345-0@lo:101: 00010000:00010000:3.0:1788744222.590667:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744222.590678:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590700:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590710:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590730:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061aa00, rc 0) 00000100:00100000:3.0:1788744222.590765:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154385664:12345-0@lo:101: Request processed in 110us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.590772:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744222.590807:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385664:0@lo:101: 00010000:00010000:3.0:1788744222.590818:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.590826:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744222.590955:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385792:0@lo:501: 00000100:00100000:3.0:1788744222.590979:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.590994:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.591005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385792 00000100:00100000:3.0:1788744222.591009:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385792 00000100:00100000:3.0:1788744222.591032:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744222.591037:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154385792:12345-0@lo:501: 00000100:00100000:3.0:1788744222.591156:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154385792:12345-0@lo:501: Request processed in 118us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.591163:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744222.591191:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385792:0@lo:501: 00000100:00100000:3.0:1788744222.591230:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385920:0@lo:503: 00000100:00100000:3.0:1788744222.591266:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.591280:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.591297:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154385920 00000100:00100000:3.0:1788744222.591301:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154385920 00000100:00100000:3.0:1788744222.591322:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744222.591328:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154385920:12345-0@lo:503: 00000100:00100000:3.0:1788744222.591421:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154385920:12345-0@lo:503: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.591427:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744222.591465:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154385920:0@lo:503: 00000100:00100000:3.0:1788744222.591675:0:7967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7967:1875634154386048:0@lo:502: 00000100:00100000:3.0:1788744222.591707:0:7967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.591724:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386048 00000100:00100000:3.0:1788744222.591728:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386048 00000100:00100000:3.0:1788744222.591748:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744222.591754:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7967:x1875634154386048:12345-0@lo:502: 00000100:00100000:3.0:1788744222.591821:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7967:x1875634154386048:12345-0@lo:502: Request processed in 66us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.591827:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744222.591856:0:7967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556a79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.594972:0:7967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7967:1875634154386048:0@lo:502: 00000100:00100000:3.0:1788744222.595057:0:7967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7967:1875634154386176:0@lo:502: 00000100:00100000:3.0:1788744222.600217:0:7967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.600265:0:7967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556a79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.600359:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386176 00000100:00100000:1.0:1788744222.600368:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386176 00000100:00100000:1.0:1788744222.600443:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744222.600453:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7967:x1875634154386176:12345-0@lo:502: 00000100:00100000:1.0:1788744222.600574:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:7967:x1875634154386176:12345-0@lo:502: Request processed in 122us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.600581:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744222.600693:0:7967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7967:1875634154386176:0@lo:502: 00000040:00080000:3.0:1788744222.600729:0:7967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788744222.601147:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788744222.601171:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744222.601180:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.601192:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744222.601201:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744222.601204:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75196e800 from 4 10000000:01000000:1.0:1788744222.601207:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744222.601239:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.601248:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.601258:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744222.601287:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386304:0@lo:101: 00000100:00100000:1.0:1788744222.601323:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.601352:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.601552:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386304 00000100:00100000:3.0:1788744222.601559:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386304 00000100:00100000:3.0:1788744222.601594:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744222.601600:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154386304:12345-0@lo:101: 00010000:00010000:3.0:1788744222.601610:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744222.601621:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe88 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.601641:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.601651:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.601660:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061b600, rc 0) 00000100:00100000:3.0:1788744222.601698:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154386304:12345-0@lo:101: Request processed in 98us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.601704:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744222.601739:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386304:0@lo:101: 00010000:00010000:3.0:1788744222.601750:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744222.601758:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744222.601798:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386432:0@lo:256: 00000100:00100000:3.0:1788744222.601828:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.601841:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556a7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.601852:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386432 00000100:00100000:3.0:1788744222.601855:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386432 00000100:00100000:3.0:1788744222.605335:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788744222.605370:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154386432:12345-0@lo:256: 20000000:01000000:3.0:1788744222.605396:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744222.605426:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744222.605429:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788744222.605550:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154386432:12345-0@lo:256: Request processed in 189us (3721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.605559:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744222.611019:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386432:0@lo:256: 10000000:01000000:2.0:1788744222.611106:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744222.611117:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.611127:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744222.611136:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788744222.611138:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788744222.611141:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788744222.611178:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.611186:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.611195:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.611213:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386560:0@lo:101: 00000100:00100000:2.0:1788744222.611269:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.611318:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.611318:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386560 00000100:00100000:1.0:1788744222.611327:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386560 00000100:00100000:1.0:1788744222.611381:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744222.611390:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154386560:12345-0@lo:101: 00010000:00010000:1.0:1788744222.611420:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744222.611432:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbe96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.611455:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.611464:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.611472:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c5e00, rc 0) 00000100:00100000:1.0:1788744222.611511:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154386560:12345-0@lo:101: Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.611518:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744222.611552:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386560:0@lo:101: 00010000:00010000:1.0:1788744222.611565:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744222.611575:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744222.611644:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386688:0@lo:501: 00000100:00100000:1.0:1788744222.611668:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.611700:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.611955:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386688 00000100:00100000:2.0:1788744222.611961:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386688 00000100:00100000:2.0:1788744222.611996:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744222.612003:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154386688:12345-0@lo:501: 00000100:00100000:2.0:1788744222.612122:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154386688:12345-0@lo:501: Request processed in 119us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.612128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744222.614079:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386688:0@lo:501: 00000100:00100000:1.0:1788744222.614132:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386816:0@lo:503: 00000100:00100000:1.0:1788744222.614196:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.614234:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.615254:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386816 00000100:00100000:3.0:1788744222.615263:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386816 00000100:00100000:3.0:1788744222.615392:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744222.615421:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154386816:12345-0@lo:503: 00000100:00100000:3.0:1788744222.615538:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154386816:12345-0@lo:503: Request processed in 138us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.615545:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744222.615657:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154386816:0@lo:503: 00000100:00100000:1.0:1788744222.626580:0:7968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7968:1875634154386944:0@lo:502: 00000100:00100000:1.0:1788744222.626659:0:7968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.626701:0:7968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.626762:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154386944 00000100:00100000:2.0:1788744222.626769:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154386944 00000100:00100000:2.0:1788744222.626803:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744222.626811:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:7968:x1875634154386944:12345-0@lo:502: 00000100:00100000:2.0:1788744222.626949:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:7968:x1875634154386944:12345-0@lo:502: Request processed in 137us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.626957:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744222.627117:0:7968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7968:1875634154386944:0@lo:502: 00000020:01000000:1.0:1788744222.627144:0:7968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744222.627155:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744222.627158:0:7968:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788744222.627162:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744222.627166:0:7968:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:1.0:1788744222.627187:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744222.627208:0:7968:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ac77c9b99c0) 00000020:00000080:1.0:1788744222.627239:0:7968:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788744222.627245:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744222.627321:0:7968:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788744222.627326:0:7968:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788744222.627333:0:7968:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbeab 00010000:00080000:1.0:1788744222.627359:0:7968:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac77c9e5800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744222.628910:0:7968:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788744222.640131:0:7968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744222.640147:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788744222.640182:0:7968:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788744222.640314:0:7968:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcbeb2 00000100:00080000:3.0:1788744222.640326:0:7968:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744222.640337:0:7968:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ac77c9e5800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744222.640373:0:7968:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac76e015180 x1875634154387072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744222.640422:0:7968:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788744222.640455:0:7968:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788744222.640650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154387072:0@lo:38: 00000100:00100000:2.0:1788744222.640725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.640833:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387072 00000100:00100000:2.0:1788744222.640840:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387072 00000100:00100000:2.0:1788744222.640868:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744222.640875:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875634154387072:12345-0@lo:38: 00010000:00080000:2.0:1788744222.640898:0:6520:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1788744222.640928:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcbeb9 00000004:00100000:2.0:1788744222.640940:0:6520:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788744222.640945:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788744222.641010:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154387200:0@lo:400: 00000100:00100000:2.0:1788744222.641042:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.641100:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154387328:0@lo:400: 00000100:00100000:2.0:1788744222.641124:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.641138:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744222.641144:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154387456:0@lo:400: 00000100:00100000:2.0:1788744222.641164:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.641191:0:6521:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788744222.641199:0:6521:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788744222.641346:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387200 00000100:00100000:2.0:1788744222.641351:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387200 00000100:00100000:2.0:1788744222.641382:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387456 00000100:00100000:2.0:1788744222.641386:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387456 00000100:00100000:2.0:1788744222.641430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744222.641438:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154387200:12345-0@lo:400: 00000100:00100000:2.0:1788744222.641486:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154387200:12345-0@lo:400: Request processed in 49us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.641493:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744222.641516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744222.641522:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154387456:12345-0@lo:400: 00000100:00100000:2.0:1788744222.641558:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154387456:12345-0@lo:400: Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.641563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788744222.643367:0:7972:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9ac75d4bdf80 x1875634154387584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744222.643385:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8780 going to sleep for 0 seconds 00000020:01000000:3.0:1788744222.644395:0:7968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744222.644415:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.644417:0:7968:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788744222.644420:0:7968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744222.644430:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.644432:0:7968:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744222.644435:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744222.644437:0:7968:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788744222.644462:0:7968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7968:1875634154387712:0@lo:502: 00000100:00100000:3.0:1788744222.644527:0:7968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.644559:0:7968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.645164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387712 00000100:00100000:1.0:1788744222.645172:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387712 00000100:00100000:1.0:1788744222.645229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744222.645239:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:7968:x1875634154387712:12345-0@lo:502: 00000100:00100000:1.0:1788744222.645359:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:7968:x1875634154387712:12345-0@lo:502: Request processed in 122us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.645367:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744222.645555:0:7968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7968:1875634154387712:0@lo:502: 00000020:01000000:3.0:1788744222.645581:0:7968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744222.645586:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.645588:0:7968:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744222.645592:0:7968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:2.0:1788744222.651821:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac77aaa5180 x1875634154387200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744222.651842:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154387200:0@lo:400: 00010000:00080000:2.0:1788744222.651898:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac77aaa4700 x1875634154387456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744222.651909:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154387456:0@lo:400: 00000020:01000000:2.0:1788744222.651929:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788744222.651965:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744222.651977:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.651990:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744222.652000:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744222.652003:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75196e800 from 1 10000000:01000000:2.0:1788744222.652006:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744222.652040:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.652048:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.652086:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.652109:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154387840:0@lo:101: 00000100:00100000:2.0:1788744222.652167:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.652213:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.652231:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387840 00000100:00100000:2.0:1788744222.652236:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387840 00000100:00100000:2.0:1788744222.652275:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744222.652284:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154387840:12345-0@lo:101: 00010000:00010000:2.0:1788744222.652295:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744222.652306:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.652327:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.652338:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.652346:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741534200, rc 0) 00000100:00100000:2.0:1788744222.652380:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154387840:12345-0@lo:101: Request processed in 97us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.652386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744222.652449:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154387840:0@lo:101: 00010000:00010000:2.0:1788744222.652461:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.652479:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.652530:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154387968:0@lo:501: 00000100:00100000:2.0:1788744222.652553:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.652567:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.652588:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387968 00000100:00100000:2.0:1788744222.652592:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387968 00000100:00100000:2.0:1788744222.652612:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788744222.652619:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154387968:12345-0@lo:501: 00000100:00100000:2.0:1788744222.652711:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154387968:12345-0@lo:501: Request processed in 92us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.652718:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788744222.652746:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154387968:0@lo:501: 00000100:00100000:2.0:1788744222.652769:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154388096:0@lo:503: 00000100:00100000:2.0:1788744222.652806:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.652819:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.652830:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388096 00000100:00100000:2.0:1788744222.652834:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388096 00000100:00100000:2.0:1788744222.652854:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744222.652859:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154388096:12345-0@lo:503: 00000100:00100000:2.0:1788744222.652928:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154388096:12345-0@lo:503: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.652935:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744222.652972:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154388096:0@lo:503: 00000100:00100000:3.0:1788744222.658950:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7974:1875634154388224:0@lo:502: 00000100:00100000:3.0:1788744222.659035:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744222.659213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388224 00000100:00100000:0.0:1788744222.659228:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388224 00000100:00100000:0.0:1788744222.659268:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744222.659278:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:7974:x1875634154388224:12345-0@lo:502: 00000100:00100000:0.0:1788744222.659394:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:7974:x1875634154388224:12345-0@lo:502: Request processed in 117us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744222.659450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744222.659947:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556a7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.659971:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7974:1875634154388224:0@lo:502: 00000020:01000000:3.0:1788744222.660001:0:7974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744222.660010:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.660012:0:7974:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744222.660020:0:7974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac75196e800 00000020:00000080:3.0:1788744222.660023:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744222.660045:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7974:1875634154388352:0@lo:502: 00000100:00100000:3.0:1788744222.660104:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.660133:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b9350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744222.660271:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388352 00000100:00100000:0.0:1788744222.660277:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388352 00000100:00100000:0.0:1788744222.660301:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744222.660307:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:7974:x1875634154388352:12345-0@lo:502: 00000100:00100000:0.0:1788744222.660383:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:7974:x1875634154388352:12345-0@lo:502: Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744222.660390:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788744222.660991:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9ac77cadd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744222.661053:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875634154387072:12345-0@lo:38: Request processed in 20176us (20326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.661061:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744222.661295:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:7974:1875634154388352:0@lo:502: 00000020:01000000:3.0:1788744222.661319:0:7974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744222.661324:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744222.661326:0:7974:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788744222.661337:0:7974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:0.0:1788744222.661503:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744222.661511:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788744222.661517:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788744222.661523:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788744222.661525:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac77c9e5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788744222.661541:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002280b693): req@ffff9ac75d4bdf80 x1875634154387584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744222.661557:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154387072:0@lo:38: 00000100:00100000:0.0:1788744222.661949:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154388480:0@lo:41: 00000100:00100000:0.0:1788744222.661985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.662031:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387328 00000100:00100000:1.0:1788744222.662037:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387328 00000100:00100000:1.0:1788744222.662061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388480 00000100:00100000:1.0:1788744222.662072:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388480 00000100:00100000:1.0:1788744222.662250:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744222.662260:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154387328:12345-0@lo:400: 00000100:00100000:1.0:1788744222.662312:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154387328:12345-0@lo:400: Request processed in 54us (21186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.662318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744222.662333:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744222.662339:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154388480:12345-0@lo:41: 00000004:00000024:1.0:1788744222.662356:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788744222.662393:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154388480:12345-0@lo:41: Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.662415:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744222.662467:0:7972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.662481:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.662492:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154387584 00000100:00100000:1.0:1788744222.662495:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154387584 00000100:00100000:1.0:1788744222.662510:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744222.662516:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154387584:12345-0@lo:1000: 00000100:00100000:1.0:1788744222.662582:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154387584:12345-0@lo:1000: Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.662588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744222.662619:0:7972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154387584:0@lo:1000: 00000040:01000000:1.0:1788744222.662645:0:7972:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788744222.662671:0:7972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154388608:0@lo:1000: 00000100:00100000:1.0:1788744222.662696:0:7972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.662708:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.662717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388608 00000100:00100000:1.0:1788744222.662720:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388608 00000100:00100000:1.0:1788744222.662734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744222.662738:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154388608:12345-0@lo:1000: 00000100:00100000:1.0:1788744222.662814:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154388608:12345-0@lo:1000: Request processed in 75us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744222.662820:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744222.662844:0:7972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154388608:0@lo:1000: 00000100:00100000:0.0:1788744222.663641:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154388480:0@lo:41: 00000020:01000000:2.0:1788744222.663775:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788744222.663802:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744222.663811:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.663823:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744222.663832:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788744222.663834:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac750753380 from 1 10000000:01000000:2.0:1788744222.663837:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744222.663861:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.664145:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.664155:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.664170:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154388736:0@lo:101: 00000100:00100000:2.0:1788744222.664285:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.664316:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744222.664705:0:7972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154388864:0@lo:700: 00000100:00100000:1.0:1788744222.664736:0:7972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.664763:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744222.664882:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154387328:0@lo:400: 00000100:00100000:0.0:1788744222.669015:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388736 00000100:00100000:0.0:1788744222.669030:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388736 00000100:00100000:0.0:1788744222.669114:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744222.669125:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154388736:12345-0@lo:101: 00010000:00010000:0.0:1788744222.669142:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744222.669159:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744222.669186:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744222.669208:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744222.669223:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031400, rc 0) 00000100:00100000:0.0:1788744222.669293:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154388736:12345-0@lo:101: Request processed in 171us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744222.669300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744222.671104:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388864 00000100:00100000:2.0:1788744222.671116:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388864 00000100:00100000:2.0:1788744222.671163:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744222.671173:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154388864:12345-0@lo:700: 00000100:00100000:2.0:1788744222.671279:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154388864:12345-0@lo:700: Request processed in 107us (6541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.671299:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744222.671343:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154388736:0@lo:101: 00010000:00010000:2.0:1788744222.671363:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.671375:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.671459:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154388992:0@lo:501: 00000100:00100000:2.0:1788744222.671492:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.671518:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.671543:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154388992 00000100:00100000:2.0:1788744222.671547:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154388992 00000100:00100000:2.0:1788744222.671572:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744222.671579:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154388992:12345-0@lo:501: 00000100:00100000:2.0:1788744222.671646:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154388992:12345-0@lo:501: Request processed in 67us (153us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744222.671653:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744222.671683:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154388992:0@lo:501: 10000000:01000000:2.0:1788744222.671707:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788744222.671714:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744222.671722:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744222.671750:0:7972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154388864:0@lo:700: 00000100:00100000:2.0:1788744222.671886:0:7972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154389120:0@lo:1000: 00000100:00100000:2.0:1788744222.671914:0:7972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.671932:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.672007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154389120 00000100:00100000:2.0:1788744222.672011:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154389120 00000100:00100000:2.0:1788744222.672035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744222.672042:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154389120:12345-0@lo:1000: 00000100:00100000:2.0:1788744222.672111:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154389120:12345-0@lo:1000: Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744222.672117:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744222.672143:0:7972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154389120:0@lo:1000: 00000004:00080000:2.0:1788744222.672185:0:7972:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ac747617300 with version 0 00000020:00100000:2.0:1788744222.672198:0:7972:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788744222.672205:0:7972:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ac77aaa4700 x1875634154389376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744222.672216:0:7972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154389376:0@lo:1000: 00000100:00100000:2.0:1788744222.672239:0:7972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744222.672251:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744222.672629:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154389376 00000100:00100000:0.0:1788744222.672634:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154389376 00000100:00100000:0.0:1788744222.672663:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788744222.672669:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7972:x1875634154389376:12345-0@lo:1000: 00000001:00080000:0.0:1788744222.675663:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788744222.675675:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788744222.676356:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7972:x1875634154389376:12345-0@lo:1000: Request processed in 3682us (4111us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788744222.676381:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788744222.678397:0:7972:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788744222.678419:0:7972:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788744222.678438:0:7972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154389376:0@lo:1000: 00000100:00100000:3.0:1788744222.679153:0:7972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154389504:0@lo:1000: 00000100:00100000:3.0:1788744222.679645:0:7972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.679707:0:7972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.683463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154389504 00000100:00100000:2.0:1788744222.683478:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154389504 00000100:00100000:3.0:1788744222.683623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744222.683631:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7972:x1875634154389504:12345-0@lo:1000: 00000100:00100000:3.0:1788744222.683746:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7972:x1875634154389504:12345-0@lo:1000: Request processed in 115us (4101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.683753:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744222.684766:0:7972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7972:1875634154389504:0@lo:1000: 00000040:00080000:0.0:1788744222.684799:0:7972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788744222.684838:0:7972:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ac774b4c300 with version 1 00000004:00080000:1.0:1788744222.687200:0:7969:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ac7508c8840 version 1 rpc_version 1 00000020:00100000:1.0:1788744222.687330:0:7969:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788744222.687342:0:7969:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ac75d4bd180 x1875634154389760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744222.687364:0:7969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7969:1875634154389760:0@lo:1000: 00000100:00100000:1.0:1788744222.687482:0:7969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744222.687521:0:7969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744222.688365:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154389760 00000100:00100000:2.0:1788744222.688373:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154389760 00000100:00100000:2.0:1788744222.688445:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744222.688455:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7969:x1875634154389760:12345-0@lo:1000: 00000040:00080000:0.0:1788744222.690026:0:7972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744222.690110:0:7972:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788744222.690115:0:7972:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788744222.691528:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788744222.691702:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7969:x1875634154389760:12345-0@lo:1000: Request processed in 3245us (4216us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788744222.691713:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788744222.691797:0:7969:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788744222.691803:0:7969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788744222.691820:0:7969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7969:1875634154389760:0@lo:1000: 00010000:00010000:3.0:1788744223.089229:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744223.598719:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154389888:0@lo:41: 00000100:00100000:0.0:1788744223.598793:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744223.599364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154389888 00000100:00100000:2.0:1788744223.599374:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154389888 00000100:00100000:2.0:1788744223.599438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744223.599447:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154389888:12345-0@lo:41: 00000004:00000024:2.0:1788744223.599477:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788744223.599522:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154389888:12345-0@lo:41: Request processed in 76us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744223.599529:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744223.599571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154389888:0@lo:41: 00010000:00010000:3.0:1788744224.129603:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744225.138918:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744226.163160:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744227.188153:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744227.696743:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744227.696765:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154390016:0@lo:41: 00000100:00100000:2.0:1788744227.696823:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.696902:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390016 00000100:00100000:2.0:1788744227.696909:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390016 00000100:00100000:2.0:1788744227.696947:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744227.696968:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154390016:12345-0@lo:41: 00000004:00000024:2.0:1788744227.697000:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788744227.697050:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154390016:12345-0@lo:41: Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.697057:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744227.697107:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154390016:0@lo:41: 00000100:00100000:2.0:1788744227.697180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154390400:0@lo:400: 00000100:00100000:2.0:1788744227.697202:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.697238:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744227.697244:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154390272:0@lo:400: 00000100:00100000:2.0:1788744227.697265:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.697285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390272 00000100:00100000:2.0:1788744227.697289:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390272 00000100:00100000:2.0:1788744227.697310:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744227.697316:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154390272:12345-0@lo:400: 00000100:00100000:2.0:1788744227.697344:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154390272:12345-0@lo:400: Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.697351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744227.697367:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154390528:0@lo:400: 00000100:00100000:2.0:1788744227.697385:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.697423:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744227.697428:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154390144:0@lo:400: 00000100:00100000:2.0:1788744227.697451:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.697474:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390144 00000100:00100000:2.0:1788744227.697477:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390144 00000100:00100000:2.0:1788744227.697498:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744227.697503:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3645:x1875634154390144:12345-0@lo:400: 00000100:00100000:2.0:1788744227.697531:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3645:x1875634154390144:12345-0@lo:400: Request processed in 27us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.697537:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744227.697564:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154390144:0@lo:400: 00010000:00080000:2.0:1788744227.697761:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac77aaa5880 x1875634154390272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744227.697771:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154390272:0@lo:400: 00000100:00100000:2.0:1788744227.697794:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390528 00000100:00100000:2.0:1788744227.697798:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390528 00000100:00100000:2.0:1788744227.697818:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744227.697823:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154390528:12345-0@lo:400: 00000100:00100000:2.0:1788744227.697852:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154390528:12345-0@lo:400: Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.697870:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788744227.697891:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac77aaa5500 x1875634154390528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744227.697900:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154390528:0@lo:400: 00000100:00100000:2.0:1788744227.697926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390400 00000100:00100000:2.0:1788744227.697929:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390400 00000100:00100000:2.0:1788744227.697946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744227.698005:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154390400:12345-0@lo:400: 00000100:00100000:2.0:1788744227.698048:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154390400:12345-0@lo:400: Request processed in 44us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.698054:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744227.698074:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154390400:0@lo:400: 00010000:00010000:3.0:1788744228.206596:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744228.721439:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744228.721463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154390656:0@lo:41: 00000100:00100000:1.0:1788744228.721524:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744228.727634:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390656 00000100:00100000:3.0:1788744228.727648:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390656 00000100:00100000:3.0:1788744228.727712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744228.727723:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154390656:12345-0@lo:41: 00000004:00000024:3.0:1788744228.727759:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788744228.727851:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154390656:12345-0@lo:41: Request processed in 130us (6326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744228.727858:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744228.727921:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154390656:0@lo:41: 00010000:00010000:2.0:1788744229.233221:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744230.259535:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788744231.253897:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744231.253900:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788744231.253902:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788744231.254044:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ac77c9d5000 00000020:01000004:2.0:1788744231.254064:0:8423:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788744231.254076:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788744231.254088:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ac77aaacd40) 00000020:00000080:2.0:1788744231.254104:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788744231.278498:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788744231.278645:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788744231.278698:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788744231.296321:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788744231.296567:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788744231.296580:0:8423:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744231.296590:0:8423:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb6207a6e76dcbee3 00000020:01000004:2.0:1788744231.296693:0:8423:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788744231.296713:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744231.296716:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744231.296721:0:8423:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788744231.296725:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788744231.296741:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ac77cdfb380) 00000020:00000080:2.0:1788744231.296753:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788744231.304516:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744231.304870:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744231.304877:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788744231.305957:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744231.305970:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788744231.306325:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744231.306331:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788744231.319621:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744231.319787:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788744231.319794:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788744231.325311:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788744231.325322:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788744231.354166:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744231.354329:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788744231.354333:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788744231.355667:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788744231.355675:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788744231.357136:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744231.357147:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788744231.360353:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744231.360641:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788744231.360648:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788744231.361382:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788744231.361389:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788744231.406261:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744231.406519:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744231.406526:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788744231.407354:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788744231.407360:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788744231.407752:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788744231.407779:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788744231.407786:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788744231.419827:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788744231.419866:0:8423:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788744231.419869:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788744231.419871:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744231.419872:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744231.419874:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744231.419875:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744231.419876:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744231.419878:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744231.419879:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744231.419880:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744231.419882:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744231.419884:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788744231.419887:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788744231.419889:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788744231.419891:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744231.419892:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744231.419893:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744231.419894:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744231.419900:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744231.419901:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744231.419902:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744231.419903:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744231.419904:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744231.419905:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788744231.419927:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788744231.419942:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154390784:0@lo:253: 00000100:00100000:0.0:1788744231.420002:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.420113:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744231.420155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390784 00000100:00100000:1.0:1788744231.420162:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390784 00000100:00100000:1.0:1788744231.420236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788744231.420245:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+18:8423:x1875634154390784:12345-0@lo:253: 20000000:01000000:1.0:1788744231.420270:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788744231.420274:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788744231.420278:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788744231.420282:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788744231.420474:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744231.420590:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788744231.420602:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788744231.420617:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788744231.420622:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788744231.420633:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788744231.420645:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788744231.420715:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788744231.420727:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:1.0:1788744231.420739:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:1.0:1788744231.420754:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788744231.420759:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788744231.420770:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788744231.420775:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:1.0:1788744231.420784:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788744231.420790:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788744231.420800:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788744231.420812:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788744231.420868:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788744231.420877:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:1.0:1788744231.420879:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:1.0:1788744231.420890:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788744231.420895:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788744231.420906:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788744231.420910:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:1.0:1788744231.420922:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788744231.420926:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788744231.420937:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788744231.420949:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788744231.421390:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788744231.421424:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:1.0:1788744231.421427:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:1.0:1788744231.421441:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788744231.421446:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788744231.421456:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788744231.421461:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:1.0:1788744231.421471:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788744231.421475:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788744231.421486:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788744231.421507:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788744231.421518:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788744231.421521:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788744231.421525:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788744231.421563:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788744231.421565:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788744231.422046:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788744231.422066:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788744231.422079:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788744231.422243:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788744231.422261:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788744231.422274:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788744231.422282:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788744231.422284:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788744231.422634:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788744231.422652:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788744231.422665:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788744231.422794:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788744231.422811:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788744231.422825:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788744231.422833:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788744231.422834:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788744231.423056:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788744231.423172:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788744231.423188:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788744231.423201:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788744231.423209:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788744231.423210:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788744231.423578:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788744231.423595:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788744231.423607:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788744231.423726:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788744231.423742:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788744231.423754:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1788744231.423766:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788744231.423782:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423798:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423817:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423823:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423830:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423838:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423846:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423878:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.423892:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 18 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.423906:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154390912:0@lo:104: 00000100:00100000:0.0:1788744231.423962:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744231.424047:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.424055:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 18 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.424064:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391040:0@lo:104: 00000100:00100000:0.0:1788744231.424089:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744231.424152:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.424160:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 18 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.424168:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391168:0@lo:104: 00000100:00100000:0.0:1788744231.424186:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.424231:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154390912 00000100:00100000:3.0:1788744231.424238:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154390912 00000100:00100000:3.0:1788744231.424265:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391040 00000100:00100000:3.0:1788744231.424267:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391040 00000100:00100000:3.0:1788744231.424278:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744231.424286:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6510:x1875634154390912:12345-0@lo:104: 00010000:00010000:3.0:1788744231.424298:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.424352:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744231.424358:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6510:x1875634154390912:12345-0@lo:104: Request processed in 73us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744231.424365:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744231.424379:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744231.424384:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6510:x1875634154391040:12345-0@lo:104: 00010000:00010000:3.0:1788744231.424391:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.424456:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744231.424460:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6510:x1875634154391040:12345-0@lo:104: Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744231.424466:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788744231.424529:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744231.424535:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424544:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744231.424547:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424555:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744231.424562:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744231.424568:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744231.424593:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424599:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744231.424620:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424627:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbed5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424645:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744231.424648:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424653:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535200 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744231.424657:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424663:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744231.424670:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744231.424675:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744231.424687:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424693:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744231.424698:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424704:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcbe96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe9d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424712:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744231.424713:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744231.424715:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744231.424720:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744231.424735:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154391424:0@lo:103: 00000100:00100000:1.0:1788744231.424771:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.424791:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744231.424795:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154391296:0@lo:103: 00000100:00100000:1.0:1788744231.424812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.424833:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391424 00000100:00100000:1.0:1788744231.424836:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391424 00010000:00010000:1.0:1788744231.424851:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 19 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744231.424866:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391296 00000100:00100000:1.0:1788744231.424868:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391296 00010000:00010000:1.0:1788744231.424876:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 20 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744231.424887:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744231.424894:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3644:x1875634154391424:12345-0@lo:103: 00010000:00010000:1.0:1788744231.424904:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744231.424908:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 20 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424918:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 20 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.424932:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744231.424955:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3644:x1875634154391424:12345-0@lo:103: Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.424961:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744231.424972:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744231.424978:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3644:x1875634154391296:12345-0@lo:103: 00010000:00010000:1.0:1788744231.424989:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744231.424994:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 19 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425003:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 19 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425024:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744231.425044:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3644:x1875634154391296:12345-0@lo:103: Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.425050:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744231.425083:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154391296:0@lo:103: 00000100:00100000:1.0:1788744231.425090:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154391424:0@lo:103: 00010000:00010000:0.0:1788744231.425317:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.425328:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 18 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.425337:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391552:0@lo:104: 00000100:00100000:0.0:1788744231.425357:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744231.425372:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.425379:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 18 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.425388:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391680:0@lo:104: 00000100:00100000:0.0:1788744231.425426:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.425440:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8300 going to sleep for 11 seconds 00010000:00010000:0.0:1788744231.425451:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbece expref: 18 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.425460:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154390912:0@lo:104: 00010000:00010000:0.0:1788744231.425474:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcbe9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe96 expref: 17 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.425482:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391040:0@lo:104: 00000100:00100000:3.0:1788744231.425525:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391168 00000100:00100000:3.0:1788744231.425529:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391168 00000100:00100000:3.0:1788744231.425544:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391552 00000100:00100000:3.0:1788744231.425546:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391552 00000100:00100000:3.0:1788744231.425552:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391680 00000100:00100000:3.0:1788744231.425554:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391680 00000100:00100000:3.0:1788744231.425563:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744231.425568:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6510:x1875634154391168:12345-0@lo:104: 00010000:00010000:3.0:1788744231.425576:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.425619:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744231.425624:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6510:x1875634154391168:12345-0@lo:104: Request processed in 56us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744231.425629:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744231.425640:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744231.425645:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6510:x1875634154391552:12345-0@lo:104: 00010000:00010000:3.0:1788744231.425651:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.425676:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744231.425680:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6510:x1875634154391552:12345-0@lo:104: Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744231.425694:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744231.425704:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744231.425709:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6510:x1875634154391680:12345-0@lo:104: 00010000:00010000:3.0:1788744231.425716:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.425739:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788744231.425742:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6510:x1875634154391680:12345-0@lo:104: Request processed in 34us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744231.425747:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788744231.425804:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744231.425809:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425816:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061a400 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744231.425819:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425827:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744231.425833:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744231.425839:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744231.425864:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425875:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744231.425892:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425899:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061a400/0xb6207a6e76dcbe7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe81 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425909:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744231.425912:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425917:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744231.425920:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425927:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744231.425934:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744231.425939:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744231.425950:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425956:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744231.425960:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425966:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcbe2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe34 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425979:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744231.425982:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425988:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744231.425991:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.425997:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744231.426002:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744231.426018:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744231.426031:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426036:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744231.426047:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426054:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbdb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbdbd expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426065:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744231.426067:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744231.426068:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744231.426078:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154391808:0@lo:103: 00000100:00100000:1.0:1788744231.426106:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.426122:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744231.426127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154391936:0@lo:103: 00000100:00100000:1.0:1788744231.426142:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.426163:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391808 00000100:00100000:1.0:1788744231.426166:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391808 00010000:00010000:1.0:1788744231.426179:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 17 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744231.426194:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154391936 00000100:00100000:1.0:1788744231.426196:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154391936 00010000:00010000:1.0:1788744231.426204:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 18 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744231.426214:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744231.426220:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3645:x1875634154391808:12345-0@lo:103: 00010000:00010000:1.0:1788744231.426227:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744231.426231:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 18 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426240:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 18 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426250:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744231.426272:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3645:x1875634154391808:12345-0@lo:103: Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.426278:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744231.426287:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744231.426292:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3645:x1875634154391936:12345-0@lo:103: 00010000:00010000:1.0:1788744231.426305:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744231.426310:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 17 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426318:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 17 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426326:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744231.426343:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3645:x1875634154391936:12345-0@lo:103: Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.426348:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744231.426364:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154392064:0@lo:103: 00000100:00100000:1.0:1788744231.426388:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.426434:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154391936:0@lo:103: 00000100:00100000:1.0:1788744231.426441:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154391808:0@lo:103: 00010000:00010000:1.0:1788744231.426456:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744231.426462:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392064 00000100:00100000:1.0:1788744231.426464:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392064 00010000:00010000:1.0:1788744231.426475:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 17 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744231.426490:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744231.426495:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3643:x1875634154392064:12345-0@lo:103: 00010000:00010000:1.0:1788744231.426501:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744231.426505:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 17 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426513:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 17 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426528:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426536:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426549:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426556:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426563:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426569:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426574:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744231.426578:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426585:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426592:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.426599:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744231.426622:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3643:x1875634154392064:12345-0@lo:103: Request processed in 127us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.426635:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744231.426671:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154392064:0@lo:103: 00010000:00010000:0.0:1788744231.426789:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbe81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe7a expref: 16 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.426798:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391168:0@lo:104: 00010000:00010000:0.0:1788744231.426806:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061ac00/0xb6207a6e76dcbe34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe2d expref: 15 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.426813:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391552:0@lo:104: 00010000:00010000:0.0:1788744231.426820:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbdbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbdb6 expref: 14 pid: 6509 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.426827:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875634154391680:0@lo:104: 00010000:00010000:0.0:1788744231.426845:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.426853:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.426860:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.426866:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbef1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788744231.426876:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788744231.428829:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+13:8423:x1875634154390784:12345-0@lo:253: Request processed in 8581us (8822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.428840:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744231.428915:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154390784:0@lo:253: 10000000:01000000:2.0:1788744231.428927:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788744231.428945:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744231.428947:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744231.428949:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744231.428950:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788744231.428952:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744231.428953:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744231.428954:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744231.428956:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788744231.428958:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744231.428959:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744231.428975:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac77c9d5000 from lustre-OST0000 10000000:01000000:2.0:1788744231.429001:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788744231.429004:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788744231.429026:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac750753380 local copy 10000000:01000000:2.0:1788744231.429030:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744231.429060:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.429069:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.429077:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.429091:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392192:0@lo:101: 00000100:00100000:2.0:1788744231.429121:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.429178:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744231.429210:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392192 00000100:00100000:0.0:1788744231.429215:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392192 00000100:00100000:0.0:1788744231.429274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744231.429282:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+13:8423:x1875634154392192:12345-0@lo:101: 00010000:00010000:0.0:1788744231.429293:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744231.429303:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031c00/0xb6207a6e76dcbeff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbef8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.429322:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031c00/0xb6207a6e76dcbeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbef8 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.429332:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031c00/0xb6207a6e76dcbeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbef8 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.429341:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031c00, rc 0) 00000100:00100000:0.0:1788744231.429375:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392192:12345-0@lo:101: Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.429381:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788744231.429448:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392192:0@lo:101: 00010000:00010000:3.0:1788744231.429460:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.429468:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744231.429598:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392320:0@lo:501: 00000100:00100000:3.0:1788744231.429622:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.429733:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.429858:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392320 00000100:00100000:2.0:1788744231.429863:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392320 00000100:00100000:2.0:1788744231.429885:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744231.429897:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392320:12345-0@lo:501: 00000100:00100000:2.0:1788744231.429956:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392320:12345-0@lo:501: Request processed in 60us (332us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744231.429971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788744231.430033:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392320:0@lo:501: 10000000:01000000:3.0:1788744231.430044:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788744231.430058:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788744231.430063:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.430081:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.430087:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.430110:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788744231.430130:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac77c9d5000 10000000:01000000:3.0:1788744231.430134:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744231.430138:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788744231.430140:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744231.430144:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788744231.430147:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744231.430161:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.430168:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.430175:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744231.430186:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392448:0@lo:101: 00000100:00100000:3.0:1788744231.430207:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.430217:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.430259:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392448 00000100:00100000:2.0:1788744231.430263:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392448 00000100:00100000:2.0:1788744231.430279:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744231.430284:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392448:12345-0@lo:101: 00010000:00010000:2.0:1788744231.430290:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744231.430297:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbf06 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.430316:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.430328:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.430336:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535800, rc 0) 00000100:00100000:2.0:1788744231.430366:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154392448:12345-0@lo:101: Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.430371:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788744231.430640:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392448:0@lo:101: 00010000:00010000:3.0:1788744231.430650:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.430667:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744231.430712:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392576:0@lo:501: 00000100:00100000:3.0:1788744231.430734:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.430759:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744231.430789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392576 00000100:00100000:0.0:1788744231.430795:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392576 00000100:00100000:0.0:1788744231.430833:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744231.430841:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154392576:12345-0@lo:501: 00000100:00100000:0.0:1788744231.430945:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154392576:12345-0@lo:501: Request processed in 104us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.430952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1788744231.431491:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744231.431505:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.431515:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744231.431519:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.431528:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744231.431536:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744231.431541:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744231.431563:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.431569:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744231.431636:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.431644:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcbeff expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744231.431652:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154392704:0@lo:103: 00010000:00010000:0.0:1788744231.431656:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744231.431660:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744231.431661:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744231.431691:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.431760:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392704 00000100:00100000:0.0:1788744231.431766:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392704 00000100:00100000:0.0:1788744231.431800:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744231.431808:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3644:x1875634154392704:12345-0@lo:103: 00010000:00010000:0.0:1788744231.431828:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744231.431841:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031c00/0xb6207a6e76dcbeff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcbef8 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.431851:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744231.431884:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3644:x1875634154392704:12345-0@lo:103: Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.431890:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744231.431918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154392704:0@lo:103: 00000100:00100000:3.0:1788744231.432034:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392576:0@lo:501: 00000100:00100000:3.0:1788744231.432058:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392832:0@lo:503: 00000100:00100000:3.0:1788744231.432093:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.432117:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744231.432138:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392832 00000100:00100000:0.0:1788744231.432144:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392832 00000100:00100000:0.0:1788744231.432176:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788744231.432183:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392832:12345-0@lo:503: 00000100:00100000:0.0:1788744231.432336:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392832:12345-0@lo:503: Request processed in 153us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.432343:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788744231.432542:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392832:0@lo:503: 00000040:00080000:3.0:1788744231.432798:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744231.432858:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392960:0@lo:502: 00000100:00100000:3.0:1788744231.432895:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.432930:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.433064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154392960 00000100:00100000:2.0:1788744231.433078:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154392960 00000100:00100000:2.0:1788744231.433113:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788744231.433121:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392960:12345-0@lo:502: 00000100:00100000:2.0:1788744231.433210:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154392960:12345-0@lo:502: Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.433217:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788744231.433293:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154392960:0@lo:502: 00000040:00080000:3.0:1788744231.433575:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788744231.433615:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788744231.433630:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788744231.433642:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788744231.433656:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788744231.433668:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788744231.433698:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393088:0@lo:502: 00000100:00100000:3.0:1788744231.433734:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.433752:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.433951:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393088 00000100:00100000:2.0:1788744231.433958:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393088 00000100:00100000:2.0:1788744231.434013:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744231.434021:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154393088:12345-0@lo:502: 00000100:00100000:2.0:1788744231.434097:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154393088:12345-0@lo:502: Request processed in 77us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.434104:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788744231.434232:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393088:0@lo:502: 00000040:00080000:3.0:1788744231.434275:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788744231.434283:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788744231.434963:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744231.434971:0:8446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788744231.434978:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744231.434980:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788744231.434985:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744231.434999:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ac774903380) 00000020:00000080:3.0:1788744231.435030:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788744231.435037:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788744231.435211:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac77c9d5000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788744231.435220:0:8446:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788744231.435230:0:8446:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb6207a6e76dcbf1b 00010000:00010000:3.0:1788744231.444780:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788744231.445995:0:8446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788744231.448744:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788744231.450595:0:8446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788744231.457746:0:8446:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788744231.457915:0:8446:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788744231.473730:0:8446:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788744231.475249:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788744231.475261:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744231.475268:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744231.475270:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788744231.475274:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744231.475279:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744231.475281:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744231.475284:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744231.475286:0:8446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788744231.475306:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744231.475310:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744231.475317:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744231.475321:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788744231.475652:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788744231.475680:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788744231.475701:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.475712:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744231.475720:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac77c9d5000 from 1 10000000:01000000:2.0:1788744231.475723:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744231.475755:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.475762:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.475772:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.475792:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393216:0@lo:101: 00000100:00100000:2.0:1788744231.475847:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.477125:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a48cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744231.478138:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393216 00000100:00100000:1.0:1788744231.478148:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393216 00000100:00100000:1.0:1788744231.478200:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744231.478209:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:8423:x1875634154393216:12345-0@lo:101: 00010000:00010000:1.0:1788744231.478223:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744231.478250:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbf22 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.478278:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.478290:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744231.478299:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c4200, rc 0) 00000100:00100000:1.0:1788744231.481542:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393216:12345-0@lo:101: Request processed in 3326us (5686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.481555:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788744231.481624:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393216:0@lo:101: 00010000:00010000:3.0:1788744231.481648:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744231.481662:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744231.481777:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393344:0@lo:501: 00000100:00100000:3.0:1788744231.481826:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.481870:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74733bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744231.481913:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393344 00000100:00100000:0.0:1788744231.481920:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393344 00000100:00100000:0.0:1788744231.482026:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788744231.482038:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393344:12345-0@lo:501: 00000100:00100000:0.0:1788744231.482160:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393344:12345-0@lo:501: Request processed in 126us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.482168:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788744231.482277:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393344:0@lo:501: 00000100:00100000:3.0:1788744231.482304:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393472:0@lo:503: 00000100:00100000:3.0:1788744231.482341:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.482425:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74733bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744231.484560:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393472 00000100:00100000:1.0:1788744231.484572:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393472 00000100:00100000:1.0:1788744231.484726:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788744231.484738:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393472:12345-0@lo:503: 00000100:00100000:1.0:1788744231.484886:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393472:12345-0@lo:503: Request processed in 150us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.484901:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788744231.484950:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393472:0@lo:503: 00000040:00080000:3.0:1788744231.485195:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744231.485279:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393600:0@lo:502: 00000100:00100000:3.0:1788744231.485323:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.485359:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b10e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.485363:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393600 00000100:00100000:2.0:1788744231.485370:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393600 00000100:00100000:2.0:1788744231.485422:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788744231.485446:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393600:12345-0@lo:502: 00000100:00100000:2.0:1788744231.485632:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393600:12345-0@lo:502: Request processed in 187us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.485639:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788744231.485852:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393600:0@lo:502: 00000040:00080000:3.0:1788744231.486055:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788744231.486082:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788744231.486103:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393728:0@lo:502: 00000100:00100000:3.0:1788744231.486135:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.486168:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74733bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744231.486304:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393728 00000100:00100000:1.0:1788744231.486310:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393728 00000100:00100000:1.0:1788744231.486344:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744231.486352:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393728:12345-0@lo:502: 00000100:00100000:1.0:1788744231.486450:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393728:12345-0@lo:502: Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744231.486468:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788744231.486820:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393728:0@lo:502: 00000040:00080000:3.0:1788744231.486861:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788744231.486869:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788744231.487382:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744231.487390:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744231.487392:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788744231.487422:0:8450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac77c9d5000 00000020:00000080:1.0:1788744231.487425:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744231.487436:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744231.487439:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744231.487440:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788744231.487443:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788744231.487553:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788744231.487577:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744231.487627:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.487639:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744231.487682:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744231.487685:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac77c9d5000 10000000:01000000:2.0:1788744231.487688:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac77c9d5000 10000000:01000000:2.0:1788744231.487691:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744231.487695:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac77c9d5000 from 1 10000000:01000000:2.0:1788744231.487698:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744231.487721:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.487729:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.487739:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.487753:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393856:0@lo:101: 00000100:00100000:2.0:1788744231.487788:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.487821:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.487836:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393856 00000100:00100000:2.0:1788744231.487841:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393856 00000100:00100000:2.0:1788744231.487867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788744231.487874:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8423:x1875634154393856:12345-0@lo:101: 00010000:00010000:2.0:1788744231.487884:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744231.487894:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbf30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.487913:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.487921:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.487929:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535200, rc 0) 00000100:00100000:2.0:1788744231.487961:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154393856:12345-0@lo:101: Request processed in 87us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.487967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788744231.488017:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393856:0@lo:101: 00010000:00010000:2.0:1788744231.488038:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.488046:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.488105:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393984:0@lo:501: 00000100:00100000:2.0:1788744231.488324:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.488339:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.488357:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154393984 00000100:00100000:2.0:1788744231.488361:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154393984 00000100:00100000:2.0:1788744231.488382:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744231.488387:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154393984:12345-0@lo:501: 00000100:00100000:2.0:1788744231.488498:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154393984:12345-0@lo:501: Request processed in 109us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.488504:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744231.488538:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154393984:0@lo:501: 00000100:00100000:2.0:1788744231.488561:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154394112:0@lo:503: 00000100:00100000:2.0:1788744231.488593:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.488606:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.488618:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394112 00000100:00100000:2.0:1788744231.488622:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394112 00000100:00100000:2.0:1788744231.488642:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744231.488648:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154394112:12345-0@lo:503: 00000100:00100000:2.0:1788744231.488717:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154394112:12345-0@lo:503: Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.488723:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744231.488760:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154394112:0@lo:503: 00000040:00080000:2.0:1788744231.488941:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744231.488991:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154394240:0@lo:502: 00000100:00100000:2.0:1788744231.489115:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.489195:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762b06900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744231.489210:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394240 00000100:00100000:2.0:1788744231.489214:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394240 00000100:00100000:2.0:1788744231.489235:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744231.489242:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154394240:12345-0@lo:502: 00000100:00100000:2.0:1788744231.489321:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154394240:12345-0@lo:502: Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.489328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744231.489366:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154394240:0@lo:502: 00000040:00080000:2.0:1788744231.489547:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788744231.489572:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788744231.489587:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788744231.489603:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788744231.489618:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788744231.489632:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788744231.489648:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788744231.489664:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788744231.489680:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788744231.489707:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788744231.489723:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788744231.489738:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788744231.489752:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788744231.489767:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788744231.489782:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788744231.489798:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788744231.489812:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788744231.489827:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788744231.489842:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788744231.489858:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788744231.489872:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788744231.489888:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788744231.489903:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788744231.489917:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788744231.489932:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788744231.489957:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788744231.489974:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788744231.489998:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788744231.490308:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788744231.490327:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788744231.490342:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788744231.490357:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788744231.490372:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788744231.490387:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788744231.491998:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788744231.492061:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788744231.492080:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788744231.492119:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154394368:0@lo:502: 00000100:00100000:2.0:1788744231.492182:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.492787:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762b06900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744231.493240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394368 00000100:00100000:0.0:1788744231.493249:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394368 00000100:00100000:0.0:1788744231.493300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788744231.493310:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154394368:12345-0@lo:502: 00000100:00100000:0.0:1788744231.496189:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154394368:12345-0@lo:502: Request processed in 2874us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.496202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744231.496710:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154394368:0@lo:502: 00000040:00080000:2.0:1788744231.496798:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788744231.496812:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788744231.497348:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788744231.497363:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ac77b988000) 00000020:00000080:0.0:1788744231.497514:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788744231.497585:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac77c9d5000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788744231.497591:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac77c9d5000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788744231.498159:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac77c9d5000 3 00010000:00080000:0.0:1788744231.498192:0:8451:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac642272800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744231.504376:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788744231.505872:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788744231.505921:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744231.505932:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb6207a6e76dcbf45 00000100:00080000:1.0:1788744231.505942:0:8451:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744231.505955:0:8451:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac642272800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744231.505992:0:8451:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac641b44700 x1875634154394496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744231.506030:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788744231.506799:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154394496:0@lo:38: 00000100:00100000:2.0:1788744231.506870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.507585:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154394624:0@lo:400: 00000100:00100000:1.0:1788744231.507630:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154394752:0@lo:400: 00000100:00100000:1.0:1788744231.507668:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.508000:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394752 00000100:00100000:2.0:1788744231.508020:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394752 00000100:00100000:2.0:1788744231.508064:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744231.508073:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154394752:12345-0@lo:400: 00000100:00100000:2.0:1788744231.508128:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154394752:12345-0@lo:400: Request processed in 55us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.508135:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744231.508174:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154394752:0@lo:400: 00000100:00100000:1.0:1788744231.508379:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.508490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394496 00000100:00100000:0.0:1788744231.508497:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394496 00000100:00100000:0.0:1788744231.508523:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394624 00000100:00100000:0.0:1788744231.508526:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394624 00000100:00100000:0.0:1788744231.508553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744231.508564:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154394624:12345-0@lo:400: 00000020:01000004:1.0:1788744231.508568:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788744231.508585:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ac77c9b8000) 00000020:00000080:1.0:1788744231.508605:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:0.0:1788744231.508616:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154394624:12345-0@lo:400: Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.508623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744231.508640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744231.508644:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875634154394496:12345-0@lo:38: 00010000:00080000:0.0:1788744231.508665:0:6516:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:01000004:1.0:1788744231.508704:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac77c9d5000 from lustre-OST0000, refs=3 00000020:00000080:0.0:1788744231.508705:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb6207a6e76dcbf53 00000020:01000004:1.0:1788744231.508711:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac77c9d5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788744231.508716:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac77c9d5000 3 00000004:00100000:0.0:1788744231.508721:0:6516:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1788744231.508751:0:8451:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac641b55000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.104@tcp at head 00000100:00080000:0.0:1788744231.508757:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9ac642276000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744231.508801:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875634154394496:12345-0@lo:38: Request processed in 155us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.508818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744231.508843:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154394880:0@lo:400: 00000100:00100000:0.0:1788744231.508873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.508893:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744231.508900:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154395008:0@lo:400: 00000100:00100000:0.0:1788744231.508918:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.508951:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154394880 00000100:00100000:0.0:1788744231.508954:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154394880 00000100:00100000:0.0:1788744231.508978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744231.508983:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154394880:12345-0@lo:400: 00000100:00100000:0.0:1788744231.509029:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154394880:12345-0@lo:400: Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.509035:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788744231.509071:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac641b44700 x1875634154394496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744231.509081:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744231.509087:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788744231.509095:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744231.509099:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744231.509101:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744231.509106:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154394496:0@lo:38: 00000100:00100000:0.0:1788744231.509193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395008 00000100:00100000:0.0:1788744231.509197:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395008 00000100:00100000:0.0:1788744231.509223:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744231.509231:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154395008:12345-0@lo:400: 00000100:00100000:0.0:1788744231.509264:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154395008:12345-0@lo:400: Request processed in 34us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.509278:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744231.509303:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154395008:0@lo:400: 00010000:00080000:0.0:1788744231.509311:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac76e016d80 x1875634154394880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744231.509317:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154394880:0@lo:400: 00010000:00080000:0.0:1788744231.509338:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac76e014700 x1875634154394624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744231.509343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154394624:0@lo:400: 00010000:00010000:1.0:1788744231.513646:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788744231.513833:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788744231.513877:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744231.513891:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb6207a6e76dcbf5a 00000100:00080000:1.0:1788744231.513903:0:8451:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744231.513917:0:8451:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ac641b55000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744231.513950:0:8451:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac641b45c00 x1875634154395136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744231.513971:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788744231.514316:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875634154395136:0@lo:38: 00000100:00100000:2.0:1788744231.514380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.514517:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395136 00000100:00100000:0.0:1788744231.514524:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395136 00000100:00100000:0.0:1788744231.514557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744231.514564:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154395136:12345-0@lo:38: 00010000:00080000:0.0:1788744231.514588:0:6517:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788744231.514620:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb6207a6e76dcbf61 00000004:00100000:0.0:1788744231.514633:0:6517:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744231.514661:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ac642273000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744231.514709:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875634154395136:12345-0@lo:38: Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.514716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788744231.515058:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac641b45c00 x1875634154395136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744231.515068:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744231.515076:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788744231.515083:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788744231.515087:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788744231.515090:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac641b55000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788744231.515095:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875634154395136:0@lo:38: 00000040:00080000:1.0:1788744231.520190:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788744231.521538:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788744231.521572:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744231.521595:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.521608:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788744231.521666:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788744231.521668:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744231.521669:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744231.521671:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744231.521672:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744231.521673:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744231.521675:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744231.521676:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744231.521677:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744231.521679:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744231.521680:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744231.521684:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788744231.521687:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788744231.521688:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744231.521689:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744231.521690:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744231.521691:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744231.521692:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744231.521694:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744231.521694:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744231.521696:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744231.521697:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744231.521698:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744231.521731:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788744231.521749:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154395264:0@lo:253: 00000100:00100000:0.0:1788744231.521920:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744231.522281:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ad06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744231.522308:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395264 00000100:00100000:0.0:1788744231.522316:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395264 00000100:00100000:0.0:1788744231.522361:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788744231.522371:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154395264:12345-0@lo:253: 20000000:01000000:0.0:1788744231.522398:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788744231.522442:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788744231.538122:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788744231.538155:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788744231.538301:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744231.538307:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744231.538328:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.538351:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.538361:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.538369:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.538443:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.538459:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 16 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.538473:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154395392:0@lo:104: 00000100:00100000:0.0:1788744231.538481:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:8423:x1875634154395264:12345-0@lo:253: Request processed in 16109us (16558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744231.538491:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788744231.538521:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744231.538599:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:8423:1875634154395264:0@lo:253: 10000000:01000000:1.0:1788744231.538611:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788744231.538614:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744231.538616:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744231.538617:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744231.538618:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744231.538619:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744231.538621:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744231.538622:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744231.538623:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744231.538625:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744231.538627:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744231.538635:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788744231.538649:0:8423:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788744231.540231:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.540246:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 15 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.540257:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154395520:0@lo:104: 00000100:00100000:2.0:1788744231.540287:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744231.540549:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788744231.540630:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744231.540681:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395392 00000100:00100000:3.0:1788744231.540688:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395392 00000100:00100000:2.0:1788744231.540726:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395520 00000100:00100000:2.0:1788744231.540728:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395520 00000100:00100000:2.0:1788744231.540745:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744231.540752:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6531:x1875634154395392:12345-0@lo:104: 00010000:00010000:2.0:1788744231.540764:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.540819:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744231.540824:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6531:x1875634154395392:12345-0@lo:104: Request processed in 73us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.540830:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744231.540861:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744231.540866:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154395520:12345-0@lo:104: 00010000:00010000:2.0:1788744231.540873:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.540897:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744231.540900:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154395520:12345-0@lo:104: Request processed in 36us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.540905:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788744231.540926:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744231.540940:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.540946:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c4a00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744231.540950:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.540958:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744231.540964:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744231.540969:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744231.540992:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.540997:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744231.541021:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541027:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4a00/0xb6207a6e76dcbe88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe8f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541037:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744231.541040:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541045:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744231.541047:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541063:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744231.541077:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744231.541082:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744231.541093:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541098:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744231.541102:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541108:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbe5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541119:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744231.541120:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744231.541121:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744231.541132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154395776:0@lo:103: 00000100:00100000:2.0:1788744231.541167:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.541192:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744231.541197:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154395648:0@lo:103: 00000100:00100000:2.0:1788744231.541213:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744231.541234:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395776 00000100:00100000:2.0:1788744231.541237:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395776 00010000:00010000:2.0:1788744231.541250:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 16 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.541275:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395648 00000100:00100000:2.0:1788744231.541278:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395648 00010000:00010000:2.0:1788744231.541286:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 17 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.541295:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744231.541300:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3646:x1875634154395776:12345-0@lo:103: 00010000:00010000:2.0:1788744231.541307:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744231.541311:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 17 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541319:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 17 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541332:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744231.541352:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3646:x1875634154395776:12345-0@lo:103: Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.541357:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744231.541366:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744231.541370:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3646:x1875634154395648:12345-0@lo:103: 00010000:00010000:2.0:1788744231.541376:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744231.541379:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 16 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541387:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 16 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541398:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541444:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788744231.541457:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009954347s 00010000:00010000:2.0:1788744231.541461:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541468:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541475:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541481:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541486:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744231.541490:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541496:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541505:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744231.541513:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744231.541536:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3646:x1875634154395648:12345-0@lo:103: Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744231.541541:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788744231.541600:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744231.541639:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcbe8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe88 expref: 15 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744231.541655:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154395392:0@lo:104: 00000100:00100000:2.0:1788744231.541664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154395648:0@lo:103: 00010000:00010000:0.0:1788744231.541672:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbe65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe5e expref: 14 pid: 6510 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744231.541679:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154395776:0@lo:103: 00000100:00100000:0.0:1788744231.541686:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154395520:0@lo:104: 00010000:00010000:0.0:1788744231.541705:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.541715:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.541721:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744231.541727:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcbf68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788744231.547560:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788744231.547736:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788744231.549289:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788744231.549473:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788744231.549684:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788744231.549857:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788744231.550921:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788744231.561816:0:8423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788744231.561824:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788744231.561860:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744231.561900:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744231.561920:0:8423:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788744231.561944:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788744231.562723:0:8423:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744231.562893:0:8423:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788744232.303518:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788744232.378325:0:8507:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744232.378589:0:8507:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788744232.817260:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154395904:0@lo:41: 00000100:00100000:0.0:1788744232.817330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744232.817510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154395904 00000100:00100000:2.0:1788744232.817520:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154395904 00000100:00100000:2.0:1788744232.817637:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744232.817647:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154395904:12345-0@lo:41: 00000004:00000024:2.0:1788744232.817677:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788744232.824473:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154395904:12345-0@lo:41: Request processed in 6817us (7133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744232.824486:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744232.825942:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154395904:0@lo:41: 00010000:00010000:2.0:1788744233.330121:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744233.840430:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744233.840452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154396032:0@lo:41: 00000100:00100000:3.0:1788744233.840515:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744233.840570:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396032 00000100:00100000:3.0:1788744233.840577:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396032 00000100:00100000:3.0:1788744233.840623:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744233.840631:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154396032:12345-0@lo:41: 00000004:00000024:3.0:1788744233.840662:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788744233.840700:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154396032:12345-0@lo:41: Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744233.840706:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744233.840745:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154396032:0@lo:41: 00010000:00010000:3.0:1788744234.358169:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744235.376355:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744236.398735:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744236.910609:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154396288:0@lo:400: 00000100:00100000:2.0:1788744236.910678:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744236.910711:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154396160:0@lo:400: 00000100:00100000:2.0:1788744236.910735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154396800:0@lo:400: 00000100:00100000:2.0:1788744236.910776:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744236.910776:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744236.910822:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154396672:0@lo:400: 00000100:00100000:2.0:1788744236.910826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154396416:0@lo:400: 00000100:00100000:0.0:1788744236.910858:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744236.910875:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154396544:0@lo:400: 00000100:00100000:2.0:1788744236.910902:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744236.910995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396288 00000100:00100000:0.0:1788744236.911002:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396288 00000100:00100000:2.0:1788744236.911006:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396800 00000100:00100000:2.0:1788744236.911013:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396800 00000100:00100000:0.0:1788744236.911051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396544 00000100:00100000:0.0:1788744236.911055:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396544 00000100:00100000:2.0:1788744236.911059:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744236.911071:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154396288:12345-0@lo:400: 00000100:00100000:0.0:1788744236.911079:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744236.911090:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154396800:12345-0@lo:400: 00000100:00100000:2.0:1788744236.911130:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154396288:12345-0@lo:400: Request processed in 61us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744236.911140:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744236.911141:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154396800:12345-0@lo:400: Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744236.911317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744236.911333:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744236.911340:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154396544:12345-0@lo:400: 00010000:00080000:2.0:1788744236.911377:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c3100 x1875634154396288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744236.911383:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154396544:12345-0@lo:400: Request processed in 43us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744236.911398:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744236.911424:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154396288:0@lo:400: 00010000:00080000:2.0:1788744236.911442:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c0700 x1875634154396800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744236.911443:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396160 00000100:00100000:0.0:1788744236.911449:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396160 00000100:00100000:2.0:1788744236.911455:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154396800:0@lo:400: 00000100:00100000:0.0:1788744236.911490:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788744236.911497:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3645:x1875634154396160:12345-0@lo:400: 00000100:00100000:2.0:1788744236.911549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154396160:0@lo:400: 00000100:00080000:3.0:1788744236.911598:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744236.912491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396672 00000100:00100000:2.0:1788744236.912500:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396672 00000100:00100000:2.0:1788744236.912542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744236.912550:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154396672:12345-0@lo:400: 00000100:00100000:2.0:1788744236.914702:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154396672:12345-0@lo:400: Request processed in 2146us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744236.914716:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744236.914750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744236.914782:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154396928:0@lo:400: 00000100:00100000:2.0:1788744236.914815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744236.914845:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396416 00000100:00100000:2.0:1788744236.914852:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396416 00000100:00100000:2.0:1788744236.914881:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744236.914889:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154396416:12345-0@lo:400: 00000100:00100000:2.0:1788744236.914932:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154396416:12345-0@lo:400: Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744236.914938:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788744236.914990:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c3800 x1875634154396544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744236.915018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154396544:0@lo:400: 00000100:00100000:2.0:1788744236.915048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154396416:0@lo:400: 00000100:00100000:2.0:1788744236.915069:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154396672:0@lo:400: 00000100:00100000:2.0:1788744236.915087:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154396928 00000100:00100000:2.0:1788744236.915090:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154396928 00000100:00100000:2.0:1788744236.915126:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744236.915132:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154396928:12345-0@lo:400: 00000100:00100000:2.0:1788744236.915167:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154396928:12345-0@lo:400: Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744236.915173:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788744236.915188:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788744236.915202:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c0380 x1875634154396928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744236.915211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154396928:0@lo:400: 00000100:00100000:0.0:1788744236.921258:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:3645:x1875634154396160:12345-0@lo:400: Request processed in 9752us (10480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744236.921274:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000001:02000400:1.0:1788744237.323949:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788744237.422940:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744237.938741:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744237.938764:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154397056:0@lo:41: 00000100:00100000:3.0:1788744237.938823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744237.938888:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397056 00000100:00100000:3.0:1788744237.938896:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397056 00000100:00100000:3.0:1788744237.938936:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744237.938945:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154397056:12345-0@lo:41: 00000004:00000024:3.0:1788744237.938999:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788744237.939044:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154397056:12345-0@lo:41: Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744237.939052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744237.939097:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154397056:0@lo:41: 00000020:00000004:2.0:1788744238.416244:0:8848:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744238.416898:0:8848:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744238.465263:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744238.960209:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744238.960233:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154397184:0@lo:41: 00000100:00100000:1.0:1788744238.960314:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744238.961006:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397184 00000100:00100000:0.0:1788744238.961015:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397184 00000100:00100000:0.0:1788744238.961068:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744238.961077:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154397184:12345-0@lo:41: 00000004:00000024:0.0:1788744238.961106:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788744238.961150:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154397184:12345-0@lo:41: Request processed in 74us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744238.961157:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744238.961230:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154397184:0@lo:41: 00010000:00010000:1.0:1788744239.472442:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744240.495001:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788744241.413902:0:8950:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744241.414152:0:8950:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788744241.518668:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788744241.518676:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac774b65800 from 30 10000000:01000000:2.0:1788744241.518682:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744241.518728:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.518740:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.518764:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744241.518878:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397312:0@lo:101: 00000100:00100000:2.0:1788744241.518955:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.519003:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.519053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397312 00000100:00100000:0.0:1788744241.519060:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397312 00000100:00100000:0.0:1788744241.519116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788744241.519125:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:6513:x1875634154397312:12345-0@lo:101: 00010000:00010000:0.0:1788744241.519138:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744241.519150:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbf6f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.519171:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.519181:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.519201:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031400, rc 0) 00000100:00100000:0.0:1788744241.519252:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154397312:12345-0@lo:101: Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.519258:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:0.0:1788744241.519543:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744241.519701:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397312:0@lo:101: 00010000:00010000:3.0:1788744241.519716:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.519724:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744241.519783:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397440:0@lo:501: 00000100:00100000:3.0:1788744241.519811:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.519842:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744241.521073:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397440 00000100:00100000:2.0:1788744241.521083:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397440 00000100:00100000:2.0:1788744241.521128:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788744241.521137:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154397440:12345-0@lo:501: 00000100:00100000:2.0:1788744241.521290:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154397440:12345-0@lo:501: Request processed in 152us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.521298:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788744241.521624:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397440:0@lo:501: 00000100:00100000:3.0:1788744241.521668:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397568:0@lo:503: 00000100:00100000:3.0:1788744241.521722:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.521756:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.521855:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397568 00000100:00100000:0.0:1788744241.521860:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397568 00000100:00100000:0.0:1788744241.521883:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788744241.521890:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154397568:12345-0@lo:503: 00000100:00100000:0.0:1788744241.521988:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154397568:12345-0@lo:503: Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.521994:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788744241.522034:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397568:0@lo:503: 00000100:00100000:0.0:1788744241.522198:0:8953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8953:1875634154397696:0@lo:502: 00000100:00100000:0.0:1788744241.522249:0:8953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.522435:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397696 00000100:00100000:2.0:1788744241.522440:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397696 00000100:00100000:2.0:1788744241.522458:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788744241.522464:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8953:x1875634154397696:12345-0@lo:502: 00000100:00100000:2.0:1788744241.522612:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8953:x1875634154397696:12345-0@lo:502: Request processed in 148us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.522619:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788744241.523391:0:8953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.523736:0:8953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8953:1875634154397696:0@lo:502: 00000100:00100000:0.0:1788744241.523799:0:8953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8953:1875634154397824:0@lo:502: 00000100:00100000:0.0:1788744241.523847:0:8953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.523877:0:8953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744241.524056:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397824 00000100:00100000:2.0:1788744241.524062:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397824 00000100:00100000:2.0:1788744241.524095:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744241.524104:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8953:x1875634154397824:12345-0@lo:502: 00000100:00100000:2.0:1788744241.524205:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:8953:x1875634154397824:12345-0@lo:502: Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.524222:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788744241.524436:0:8953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8953:1875634154397824:0@lo:502: 00000040:00080000:3.0:1788744241.524458:0:8953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788744241.524683:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788744241.524705:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744241.524714:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.524725:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744241.524734:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788744241.524737:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac774b65800 from 5 10000000:01000000:2.0:1788744241.524740:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744241.524768:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.524776:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.524785:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744241.524798:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397952:0@lo:101: 00000100:00100000:2.0:1788744241.524826:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.524853:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.524968:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154397952 00000100:00100000:0.0:1788744241.524973:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154397952 00000100:00100000:0.0:1788744241.525003:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788744241.525010:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154397952:12345-0@lo:101: 00010000:00010000:0.0:1788744241.525028:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744241.525040:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbf7d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.525061:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.525071:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.525080:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031000, rc 0) 00000100:00100000:0.0:1788744241.525114:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154397952:12345-0@lo:101: Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.525120:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788744241.525153:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154397952:0@lo:101: 00010000:00010000:0.0:1788744241.525164:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.525173:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744241.525221:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398080:0@lo:256: 00000100:00100000:0.0:1788744241.525251:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.525398:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398080 00000100:00100000:3.0:1788744241.525424:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398080 00000100:00100000:3.0:1788744241.525446:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788744241.525460:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154398080:12345-0@lo:256: 20000000:01000000:3.0:1788744241.525474:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744241.525488:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744241.525491:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788744241.525694:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154398080:12345-0@lo:256: Request processed in 234us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.525700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788744241.526232:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.526249:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398080:0@lo:256: 10000000:01000000:0.0:1788744241.526308:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744241.526315:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526331:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744241.526338:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788744241.526340:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788744241.526342:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788744241.526364:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526372:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526390:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744241.526422:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398208:0@lo:101: 00000100:00100000:0.0:1788744241.526451:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.526475:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.526488:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398208 00000100:00100000:0.0:1788744241.526491:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398208 00000100:00100000:0.0:1788744241.526528:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788744241.526535:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154398208:12345-0@lo:101: 00010000:00010000:0.0:1788744241.526543:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744241.526551:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbf8b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526566:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526585:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526593:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030000, rc 0) 00000100:00100000:0.0:1788744241.526623:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154398208:12345-0@lo:101: Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.526628:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788744241.526655:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398208:0@lo:101: 00010000:00010000:0.0:1788744241.526665:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.526672:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744241.526733:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398336:0@lo:501: 00000100:00100000:0.0:1788744241.526755:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.526767:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.526779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398336 00000100:00100000:0.0:1788744241.526782:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398336 00000100:00100000:0.0:1788744241.526799:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788744241.526804:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154398336:12345-0@lo:501: 00000100:00100000:0.0:1788744241.526907:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154398336:12345-0@lo:501: Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.526914:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788744241.526953:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398336:0@lo:501: 00000100:00100000:0.0:1788744241.526981:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398464:0@lo:503: 00000100:00100000:0.0:1788744241.527019:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.527033:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.527044:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398464 00000100:00100000:0.0:1788744241.527047:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398464 00000100:00100000:0.0:1788744241.527067:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788744241.527072:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154398464:12345-0@lo:503: 00000100:00100000:0.0:1788744241.527141:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154398464:12345-0@lo:503: Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.527149:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788744241.527189:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398464:0@lo:503: 00000100:00100000:0.0:1788744241.527346:0:8954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8954:1875634154398592:0@lo:502: 00000100:00100000:0.0:1788744241.527380:0:8954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.527397:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398592 00000100:00100000:0.0:1788744241.527418:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398592 00000100:00100000:0.0:1788744241.527439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744241.527444:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:8954:x1875634154398592:12345-0@lo:502: 00000100:00100000:0.0:1788744241.527515:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:8954:x1875634154398592:12345-0@lo:502: Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.527522:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744241.527551:0:8954:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.527562:0:8954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8954:1875634154398592:0@lo:502: 00000020:01000000:0.0:1788744241.527582:0:8954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744241.527589:0:8954:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788744241.527596:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744241.527598:0:8954:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788744241.527602:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788744241.527610:0:8954:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1788744241.527630:0:8954:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788744241.527632:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744241.527645:0:8954:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ac77b98b380) 00000020:00000080:0.0:1788744241.527663:0:8954:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788744241.527669:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788744241.527754:0:8954:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788744241.527761:0:8954:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788744241.527767:0:8954:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcbfa0 00010000:00080000:0.0:1788744241.527792:0:8954:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac7507f8000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788744241.528014:0:8954:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788744241.536797:0:8954:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788744241.536822:0:8954:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788744241.537023:0:8954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744241.537235:0:8954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744241.537708:0:8954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788744241.537845:0:8954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788744241.542918:0:8956:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744241.542926:0:8956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788744241.554200:0:8954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744241.554215:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744241.554263:0:8954:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788744241.554860:0:8954:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcbfa7 00000100:00080000:3.0:1788744241.554872:0:8954:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744241.554884:0:8954:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ac7507f8000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744241.554919:0:8954:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac76e015500 x1875634154398720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744241.554978:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154398720:0@lo:8: 00000100:00100000:2.0:1788744241.555044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744241.555116:0:8954:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788744241.555186:0:8954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744241.555190:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744241.555192:0:8954:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788744241.555195:0:8954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744241.555199:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744241.555201:0:8954:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744241.555203:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744241.555205:0:8954:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788744241.555229:0:8954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8954:1875634154398848:0@lo:502: 00000100:00100000:3.0:1788744241.555296:0:8954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.555324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398848 00000100:00100000:3.0:1788744241.555330:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398848 00000100:00100000:3.0:1788744241.555365:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788744241.555391:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:8954:x1875634154398848:12345-0@lo:502: 00000100:00100000:1.0:1788744241.555777:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398720 00000100:00100000:1.0:1788744241.555782:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398720 00000100:00100000:1.0:1788744241.555805:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744241.555811:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875634154398720:12345-0@lo:8: 00010000:00080000:1.0:1788744241.555831:0:8430:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1788744241.555856:0:8430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcbfae 00002000:00100000:1.0:1788744241.555889:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ac641b57000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788744241.555893:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788744241.555897:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788744241.555959:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788744241.556148:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788744241.556175:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac641b56000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744241.556431:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:8954:x1875634154398848:12345-0@lo:502: Request processed in 1050us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.556439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788744241.556489:0:8954:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.556613:0:8954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8954:1875634154398848:0@lo:502: 00000020:01000000:3.0:1788744241.556642:0:8954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744241.556647:0:8954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744241.556649:0:8954:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744241.556654:0:8954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1788744241.556713:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788744241.556907:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788744241.556917:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.556929:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744241.556938:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744241.556950:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac75196e800 from 30 10000000:01000000:3.0:1788744241.556953:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744241.556977:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.556985:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.556994:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744241.557020:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398976:0@lo:101: 00000100:00100000:3.0:1788744241.557071:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.557090:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.557104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154398976 00000100:00100000:3.0:1788744241.557109:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154398976 00000100:00100000:3.0:1788744241.557137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788744241.557145:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154398976:12345-0@lo:101: 00010000:00010000:3.0:1788744241.557154:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744241.557165:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbfb5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.557185:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.557194:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.557203:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061a800, rc 0) 00000100:00100000:3.0:1788744241.557249:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154398976:12345-0@lo:101: Request processed in 106us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.557255:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788744241.557599:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154398976:0@lo:101: 00010000:00010000:3.0:1788744241.557610:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.557618:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744241.557675:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154399104:0@lo:501: 00000100:00100000:3.0:1788744241.557700:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.557718:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.557729:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399104 00000100:00100000:3.0:1788744241.557732:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399104 00000100:00100000:3.0:1788744241.557768:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788744241.557775:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154399104:12345-0@lo:501: 00000100:00100000:3.0:1788744241.557873:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154399104:12345-0@lo:501: Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.557880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788744241.557906:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154399104:0@lo:501: 00000100:00100000:3.0:1788744241.557930:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154399232:0@lo:503: 00000100:00100000:3.0:1788744241.557977:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.557990:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.558001:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399232 00000100:00100000:3.0:1788744241.558004:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399232 00000100:00100000:3.0:1788744241.558024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788744241.558030:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154399232:12345-0@lo:503: 00000100:00100000:3.0:1788744241.558103:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154399232:12345-0@lo:503: Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.558110:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788744241.558148:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154399232:0@lo:503: 00000100:00100000:1.0:1788744241.558964:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875634154398720:12345-0@lo:8: Request processed in 3151us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744241.558973:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744241.559165:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154399616:0@lo:400: 00000100:00100000:1.0:1788744241.559198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744241.559219:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788744241.559224:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154399488:0@lo:400: 00000100:00100000:1.0:1788744241.559286:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744241.559302:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154400000:0@lo:400: 00000100:00100000:1.0:1788744241.559336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744241.559361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399616 00000100:00100000:1.0:1788744241.559365:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399616 00000100:00100000:1.0:1788744241.559419:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400000 00000100:00100000:1.0:1788744241.559422:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400000 00000100:00100000:1.0:1788744241.559450:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744241.559458:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154399616:12345-0@lo:400: 00000100:00100000:1.0:1788744241.559689:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154399616:12345-0@lo:400: Request processed in 231us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744241.559695:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744241.559710:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744241.559716:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154400000:12345-0@lo:400: 00000100:00100000:1.0:1788744241.559768:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154400000:12345-0@lo:400: Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744241.559773:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788744241.559793:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788744241.559816:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b44e00 x1875634154400000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744241.559840:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154400000:0@lo:400: 00010000:00080000:1.0:1788744241.559854:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b45500 x1875634154399616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744241.559861:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154399616:0@lo:400: 00000100:00100000:0.0:1788744241.560359:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154399360:0@lo:400: 00000100:00100000:0.0:1788744241.560420:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.560444:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154399872:0@lo:400: 00000100:00100000:0.0:1788744241.560464:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.560483:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744241.560489:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154399744:0@lo:400: 00000100:00100000:0.0:1788744241.560612:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.560636:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399360 00000100:00100000:0.0:1788744241.560639:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399360 00000100:00100000:0.0:1788744241.560660:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399872 00000100:00100000:0.0:1788744241.560662:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399872 00000100:00100000:0.0:1788744241.560679:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744241.560685:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154399360:12345-0@lo:400: 00000100:00100000:0.0:1788744241.560724:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154399360:12345-0@lo:400: Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.560730:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744241.560824:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744241.560831:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154399872:12345-0@lo:400: 00000100:00100000:0.0:1788744241.560856:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154399872:12345-0@lo:400: Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.560861:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744241.560879:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399488 00000100:00100000:0.0:1788744241.560882:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399488 00000100:00100000:0.0:1788744241.560900:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154399744 00000100:00100000:0.0:1788744241.560902:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154399744 00000100:00100000:0.0:1788744241.560912:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744241.560917:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154399488:12345-0@lo:400: 00000100:00100000:0.0:1788744241.560958:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154399488:12345-0@lo:400: Request processed in 41us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.560964:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744241.560974:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744241.560980:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154399744:12345-0@lo:400: 00000100:00100000:0.0:1788744241.561001:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154399744:12345-0@lo:400: Request processed in 22us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.561006:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788744241.561020:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744241.561035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154399744:0@lo:400: 00010000:00080000:0.0:1788744241.561045:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b46a00 x1875634154399360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.561064:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154399360:0@lo:400: 00010000:00080000:0.0:1788744241.561074:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b45880 x1875634154399872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.561081:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154399872:0@lo:400: 00000100:00100000:0.0:1788744241.561108:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154399488:0@lo:400: 00000100:00100000:0.0:1788744241.562123:0:8959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8959:1875634154400128:0@lo:502: 00000100:00100000:0.0:1788744241.562170:0:8959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.562202:0:8959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7439386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.562249:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400128 00000100:00100000:3.0:1788744241.562254:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400128 00000100:00100000:3.0:1788744241.562473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788744241.562481:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:8959:x1875634154400128:12345-0@lo:502: 00000100:00100000:3.0:1788744241.562637:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:8959:x1875634154400128:12345-0@lo:502: Request processed in 158us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.562644:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744241.562887:0:8959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8959:1875634154400128:0@lo:502: 00000100:00100000:0.0:1788744241.562930:0:8959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8959:1875634154400256:0@lo:502: 00000100:00100000:0.0:1788744241.562970:0:8959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.562994:0:8959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac755654b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.563084:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400256 00000100:00100000:3.0:1788744241.563089:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400256 00000100:00100000:3.0:1788744241.563119:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744241.563125:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:8959:x1875634154400256:12345-0@lo:502: 00000100:00100000:3.0:1788744241.563242:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:8959:x1875634154400256:12345-0@lo:502: Request processed in 116us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.563248:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1788744241.565648:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac76e015500 x1875634154398720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744241.565669:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744241.565679:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788744241.565688:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788744241.565694:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788744241.565697:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac7507f8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788744241.565722:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788744241.565728:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154398720:0@lo:8: 00000100:00100000:1.0:1788744241.568676:0:8959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8959:1875634154400256:0@lo:502: 00000040:00080000:1.0:1788744241.568718:0:8959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:0.0:1788744241.570612:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154400384:0@lo:700: 00000100:00100000:0.0:1788744241.570700:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.570734:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac755654b40 going to sleep for 11 seconds 00000004:00080000:0.0:1788744241.570908:0:8956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788744241.570987:0:8956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 223252584422ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788744241.570994:0:8956:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788744241.571063:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400384 00000100:00100000:1.0:1788744241.571070:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400384 00000100:00100000:1.0:1788744241.571130:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744241.571139:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8957:x1875634154400384:12345-0@lo:700: 00000100:00100000:1.0:1788744241.571177:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875634154400512:0@lo:700: 00000100:00100000:1.0:1788744241.571208:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744241.571225:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744241.571250:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400512 00000100:00100000:1.0:1788744241.571253:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400512 00000100:00080000:0.0:1788744241.571416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744241.571480:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744241.571489:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875634154400512:12345-0@lo:700: 00000020:01000000:2.0:1788744241.573851:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788744241.573884:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744241.573894:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.573907:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744241.573918:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788744241.573920:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75196e800 from 5 10000000:01000000:2.0:1788744241.573923:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744241.573965:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.573973:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.573982:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744241.573999:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154400640:0@lo:101: 00000100:00100000:2.0:1788744241.574058:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.574095:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.574177:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400640 00000100:00100000:3.0:1788744241.574184:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400640 00000100:00100000:3.0:1788744241.574233:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744241.574242:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154400640:12345-0@lo:101: 00010000:00010000:3.0:1788744241.574253:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744241.574263:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbfc3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.574298:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.574309:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.574318:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061ae00, rc 0) 00000100:00100000:3.0:1788744241.574384:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154400640:12345-0@lo:101: Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.574397:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744241.574464:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154400640:0@lo:101: 00010000:00010000:3.0:1788744241.574476:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.574484:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744241.574667:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154400768:0@lo:256: 00000100:00100000:3.0:1788744241.574695:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.574716:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.574729:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400768 00000100:00100000:3.0:1788744241.574733:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400768 00000100:00100000:3.0:1788744241.574772:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788744241.574778:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154400768:12345-0@lo:256: 20000000:01000000:3.0:1788744241.574790:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744241.574806:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744241.574809:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788744241.574883:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154400768:12345-0@lo:256: Request processed in 104us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.574890:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788744241.574921:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154400768:0@lo:256: 10000000:01000000:3.0:1788744241.574977:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744241.574983:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.574990:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744241.575002:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788744241.575004:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788744241.575006:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744241.575023:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.575029:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.575036:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744241.575047:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154400896:0@lo:101: 00000100:00100000:3.0:1788744241.575070:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.575082:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.575093:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154400896 00000100:00100000:3.0:1788744241.575097:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154400896 00000100:00100000:3.0:1788744241.575116:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788744241.575122:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154400896:12345-0@lo:101: 00010000:00010000:3.0:1788744241.575129:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744241.575137:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbfd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.575150:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.575158:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.575175:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061aa00, rc 0) 00000100:00100000:3.0:1788744241.575203:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154400896:12345-0@lo:101: Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.575209:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788744241.575236:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154400896:0@lo:101: 00010000:00010000:3.0:1788744241.575246:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744241.575253:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744241.575309:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401024:0@lo:501: 00000100:00100000:3.0:1788744241.575332:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.575343:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.575353:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401024 00000100:00100000:3.0:1788744241.575356:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401024 00000100:00100000:3.0:1788744241.575373:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744241.575378:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154401024:12345-0@lo:501: 00000100:00100000:3.0:1788744241.575491:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154401024:12345-0@lo:501: Request processed in 112us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.576654:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744241.576701:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401024:0@lo:501: 00000100:00100000:3.0:1788744241.576738:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401152:0@lo:503: 00000100:00100000:3.0:1788744241.576793:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.576910:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf46c0 going to sleep for 11 seconds 40000000:02000000:3.0:1788744241.578848:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788744241.581868:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401152 00000100:00100000:0.0:1788744241.581881:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401152 00000100:00100000:0.0:1788744241.581932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788744241.581954:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154401152:12345-0@lo:503: 00000100:00100000:0.0:1788744241.582108:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154401152:12345-0@lo:503: Request processed in 166us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.582121:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000004:00080000:0.0:1788744241.582209:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788744241.586637:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401152:0@lo:503: 00000100:00100000:2.0:1788744241.597419:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875634154400512:12345-0@lo:700: Request processed in 25909us (26187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.597433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744241.597596:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8961:1875634154401280:0@lo:502: 00000100:00100000:2.0:1788744241.597653:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.597683:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401280 00000100:00100000:2.0:1788744241.597690:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401280 00000100:00100000:2.0:1788744241.597723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788744241.597732:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:8961:x1875634154401280:12345-0@lo:502: 00000100:00100000:2.0:1788744241.597852:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:8961:x1875634154401280:12345-0@lo:502: Request processed in 121us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.597859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788744241.597903:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a48b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744241.597924:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8961:1875634154401280:0@lo:502: 00000020:01000000:2.0:1788744241.597960:0:8961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744241.597966:0:8961:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788744241.597972:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744241.597974:0:8961:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788744241.597979:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744241.597982:0:8961:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1788744241.598005:0:8961:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788744241.598008:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744241.598022:0:8961:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ac77cdfcd40) 00000020:00000080:2.0:1788744241.598044:0:8961:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788744241.598058:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744241.598142:0:8961:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788744241.598148:0:8961:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788744241.598154:0:8961:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcbfe6 00010000:00080000:2.0:1788744241.598180:0:8961:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac776cf5000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788744241.600236:0:8961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:0.0:1788744241.601552:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b45500 x1875634154400512/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.601568:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875634154400512:0@lo:700: 40000000:02000000:0.0:1788744241.601581:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:0.0:1788744241.619605:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788744241.619708:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8957:x1875634154400384:12345-0@lo:700: Request processed in 48565us (49003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.619724:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788744241.619783:0:8957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b7bb80 x1875634154400384/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.619797:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154400384:0@lo:700: 00000040:01000000:3.0:1788744241.620002:0:8961:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788744241.620019:0:8961:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788744241.620180:0:8961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744241.620371:0:8961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744241.620489:0:8961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788744241.620817:0:8961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788744241.623750:0:8964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744241.623758:0:8964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788744241.624788:0:8961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744241.624801:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788744241.624836:0:8961:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788744241.624857:0:8961:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcbfed 00000100:00080000:0.0:1788744241.624866:0:8961:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744241.624877:0:8961:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac776cf5000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744241.624911:0:8961:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac641b7bb80 x1875634154401408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744241.624953:0:8961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788744241.625003:0:8961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744241.625013:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744241.625015:0:8961:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788744241.625020:0:8961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744241.625023:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744241.625025:0:8961:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744241.625027:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744241.625029:0:8961:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788744241.625056:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8961:1875634154401536:0@lo:502: 00000100:00100000:0.0:1788744241.625127:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.625168:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7439386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.625367:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154401408:0@lo:8: 00000100:00100000:3.0:1788744241.625447:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.625734:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401408 00000100:00100000:0.0:1788744241.625751:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401408 00000100:00100000:0.0:1788744241.625787:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744241.625795:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875634154401408:12345-0@lo:8: 00010000:00080000:0.0:1788744241.625817:0:8432:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1788744241.625838:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcbff4 00002000:00100000:0.0:1788744241.625851:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ac7507fa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788744241.625855:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788744241.625858:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788744241.625935:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788744241.625967:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ac7507fb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744241.626014:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875634154401408:12345-0@lo:8: Request processed in 218us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.626021:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744241.626151:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b7bb80 x1875634154401408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744241.626162:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744241.626169:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788744241.626177:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788744241.626181:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788744241.626183:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788744241.626198:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788744241.626202:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154401408:0@lo:8: 00000004:00080000:3.0:1788744241.626223:0:8964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788744241.626548:0:8964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 223308144801ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788744241.626555:0:8964:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788744241.628114:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401536 00000100:00100000:3.0:1788744241.628123:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401536 00000100:00100000:3.0:1788744241.628170:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788744241.628178:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:8961:x1875634154401536:12345-0@lo:502: 00000100:00100000:3.0:1788744241.628300:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:8961:x1875634154401536:12345-0@lo:502: Request processed in 123us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.628308:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788744241.629018:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:8961:1875634154401536:0@lo:502: 00000020:01000000:3.0:1788744241.629052:0:8961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744241.629059:0:8961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744241.629061:0:8961:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744241.629065:0:8961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788744241.629351:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788744241.629371:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744241.629616:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.629628:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744241.629637:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788744241.629640:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac750753380 from 1 10000000:01000000:2.0:1788744241.629643:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744241.629683:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.629691:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.629701:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744241.629719:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401664:0@lo:101: 00000100:00100000:2.0:1788744241.629770:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.629805:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a483c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.630205:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401664 00000100:00100000:0.0:1788744241.630211:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401664 00000100:00100000:0.0:1788744241.630246:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788744241.630254:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154401664:12345-0@lo:101: 00010000:00010000:0.0:1788744241.630275:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744241.630295:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcbffb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.630318:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.630328:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.630337:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031a00, rc 0) 00000100:00100000:0.0:1788744241.630392:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154401664:12345-0@lo:101: Request processed in 138us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.630398:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000004:00080000:3.0:1788744241.631660:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788744241.632177:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401664:0@lo:101: 00010000:00010000:2.0:1788744241.632211:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744241.632226:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744241.632298:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401792:0@lo:501: 00000100:00100000:2.0:1788744241.632345:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.632385:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a483c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788744241.632780:0:8957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788744241.632797:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154402048:0@lo:7: 00000100:00100000:3.0:1788744241.632831:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.632852:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744241.632863:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744241.632873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154401920:0@lo:13: 00000100:00100000:3.0:1788744241.632896:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744241.632973:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402048 00000100:00100000:1.0:1788744241.632980:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402048 00000100:00100000:1.0:1788744241.633019:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744241.633028:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8957:x1875634154402048:12345-0@lo:7: 00000100:00100000:2.0:1788744241.633466:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401920 00000100:00100000:2.0:1788744241.633471:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401920 00000100:00100000:2.0:1788744241.634597:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744241.634609:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154401920:12345-0@lo:13: 00002000:00000024:2.0:1788744241.634631:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923910656 avail 3692388352 00000100:00100000:2.0:1788744241.634690:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154401920:12345-0@lo:13: Request processed in 83us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.634696:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788744241.635044:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac76e014a80 x1875634154401920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744241.635064:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154401920:0@lo:13: 00000100:00100000:0.0:1788744241.635255:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154401792 00000100:00100000:0.0:1788744241.635261:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154401792 00000100:00100000:0.0:1788744241.635294:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788744241.635301:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154401792:12345-0@lo:501: 00000100:00100000:0.0:1788744241.635381:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154401792:12345-0@lo:501: Request processed in 80us (3035us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744241.635388:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788744241.635445:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154401792:0@lo:501: 10000000:01000000:0.0:1788744241.635474:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788744241.635482:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744241.635558:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744241.641430:0:8965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788744241.641461:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e017800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154402304:0@lo:7: 00000100:00100000:3.0:1788744241.641533:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.641572:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744241.641579:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788744241.641596:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.641736:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154402176:0@lo:13: 00000100:00100000:0.0:1788744241.641787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.641981:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402176 00000100:00100000:3.0:1788744241.641988:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402176 00000100:00100000:3.0:1788744241.642047:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744241.642056:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154402176:12345-0@lo:13: 00002000:00000024:3.0:1788744241.642076:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923910656 avail 3692388352 00000100:00100000:3.0:1788744241.642123:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154402176:12345-0@lo:13: Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744241.642130:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744241.642166:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402304 00000100:00100000:3.0:1788744241.642170:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402304 00000100:00100000:3.0:1788744241.642255:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744241.642262:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8965:x1875634154402304:12345-0@lo:7: 00000100:00080000:0.0:1788744241.642577:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744241.642608:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac76e014a80 x1875634154402176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.642627:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154402176:0@lo:13: 00002000:00080000:1.0:1788744241.649763:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788744241.649772:0:8430:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788744241.649863:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8957:x1875634154402048:12345-0@lo:7: Request processed in 16832us (17027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744241.649880:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788744241.650808:0:8957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac76e015c00 x1875634154402048/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.650824:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154402048:0@lo:7: 00000004:00080000:0.0:1788744241.650836:0:8957:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788744241.650880:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154402432:0@lo:5: 00000100:00100000:0.0:1788744241.650916:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.650957:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744241.651709:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402432 00000100:00100000:1.0:1788744241.651716:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402432 00000100:00100000:1.0:1788744241.651768:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744241.651776:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8957:x1875634154402432:12345-0@lo:5: 00002000:00080000:1.0:1788744241.651798:0:8431:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788744241.651835:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8957:x1875634154402432:12345-0@lo:5: Request processed in 60us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744241.651841:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788744241.651901:0:8957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b7b800 x1875634154402432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.651912:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154402432:0@lo:5: 00000004:00080000:0.0:1788744241.651922:0:8957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788744241.651959:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154402560:0@lo:5: 00000100:00100000:0.0:1788744241.651981:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.652006:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.652020:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402560 00000100:00100000:0.0:1788744241.652023:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402560 00000100:00100000:0.0:1788744241.652049:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744241.652056:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8957:x1875634154402560:12345-0@lo:5: 00002000:00080000:0.0:1788744241.652076:0:8432:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788744241.653501:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8957:x1875634154402560:12345-0@lo:5: Request processed in 1442us (1514us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788744241.653516:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788744241.653593:0:8957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b7b800 x1875634154402560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.653606:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8957:1875634154402560:0@lo:5: 00000004:00080000:0.0:1788744241.653615:0:8957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788744241.653642:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8957:1875634154402688:0@lo:900: 00000100:00100000:0.0:1788744241.653668:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.653685:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744241.653699:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402688 00000100:00100000:0.0:1788744241.653703:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402688 00000100:00100000:0.0:1788744241.653730:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744241.653737:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8957:x1875634154402688:12345-0@lo:900: 00000100:00100000:0.0:1788744241.653773:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8957:x1875634154402688:12345-0@lo:900: Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744241.653779:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788744241.653802:0:8957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b78e00 x1875634154402688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.653811:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8957:1875634154402688:0@lo:900: 00002000:00080000:2.0:1788744241.658352:0:8966:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788744241.658361:0:8966:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788744241.659891:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8965:x1875634154402304:12345-0@lo:7: Request processed in 17622us (18351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744241.659924:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788744241.660623:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac76e017800 x1875634154402304/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744241.660638:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e017800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154402304:0@lo:7: 00000004:00080000:3.0:1788744241.660650:0:8965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788744241.660687:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e017800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154402816:0@lo:5: 00000100:00100000:3.0:1788744241.660726:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744241.660822:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744241.660887:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402816 00000100:00100000:1.0:1788744241.660894:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402816 00000100:00100000:1.0:1788744241.660946:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744241.660956:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8965:x1875634154402816:12345-0@lo:5: 00002000:00080000:1.0:1788744241.660978:0:8432:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788744241.660982:0:8432:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788744241.672838:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788744241.672853:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788744241.672859:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788744241.673157:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8965:x1875634154402816:12345-0@lo:5: Request processed in 12199us (12427us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788744241.673168:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788744241.673255:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac76e017800 x1875634154402816/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744241.673266:0:8965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788744241.673284:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e017800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154402816:0@lo:5: 00000004:00080000:2.0:1788744241.673298:0:8965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788744241.673341:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154402944:0@lo:700: 00000100:00100000:2.0:1788744241.673373:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744241.673463:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74520d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744241.674468:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154402944 00000100:00100000:1.0:1788744241.674478:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154402944 00000100:00100000:1.0:1788744241.674529:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744241.674538:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8965:x1875634154402944:12345-0@lo:700: 00000100:00100000:1.0:1788744241.691732:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8965:x1875634154402944:12345-0@lo:700: Request processed in 17186us (18348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744241.691745:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788744241.691805:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c2680 x1875634154402944/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744241.691819:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154402944:0@lo:700: 00000004:02000040:1.0:1788744241.702322:0:8965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788744241.731656:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154403072:0@lo:5: 00000100:00100000:0.0:1788744241.731714:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744241.731767:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744241.732136:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403072 00000100:00100000:1.0:1788744241.732151:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403072 00000100:00100000:1.0:1788744241.732202:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744241.732212:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8965:x1875634154403072:12345-0@lo:5: 00002000:00080000:1.0:1788744241.753147:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788744241.753167:0:8430:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788744241.762044:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8965:x1875634154403072:12345-0@lo:5: Request processed in 29827us (30322us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788744241.762057:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788744241.762109:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b78e00 x1875634154403072/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744241.762137:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8965:1875634154403072:0@lo:5: 00000004:00080000:0.0:1788744241.762152:0:8965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:3.0:1788744242.433786:0:9007:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744242.433795:0:9007:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788744242.542527:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744243.055269:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744243.055294:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154403200:0@lo:41: 00000100:00100000:1.0:1788744243.055356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744243.056753:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403200 00000100:00100000:2.0:1788744243.056763:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403200 00000100:00100000:2.0:1788744243.056817:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744243.056825:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154403200:12345-0@lo:41: 00000004:00000024:2.0:1788744243.056855:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788744243.056918:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154403200:12345-0@lo:41: Request processed in 94us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744243.056925:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744243.057042:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154403200:0@lo:41: 00010000:00010000:0.0:1788744243.566651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744244.078824:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154403328:0@lo:41: 00000100:00100000:3.0:1788744244.078915:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744244.079112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403328 00000100:00100000:0.0:1788744244.079122:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403328 00000100:00100000:0.0:1788744244.079173:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744244.079182:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154403328:12345-0@lo:41: 00000004:00000024:0.0:1788744244.079226:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788744244.079281:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154403328:12345-0@lo:41: Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744244.079288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744244.080040:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154403328:0@lo:41: 00010000:00010000:0.0:1788744244.590705:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744245.616344:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744246.639611:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744246.640948:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154403712:0@lo:400: 00000100:00100000:0.0:1788744246.641022:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744246.641073:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154404224:0@lo:400: 00000100:00100000:0.0:1788744246.641101:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744246.641138:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788744246.641146:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154403584:0@lo:400: 00000100:00100000:0.0:1788744246.641173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744246.641194:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154404096:0@lo:400: 00000100:00100000:0.0:1788744246.641219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744246.641238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154404608:0@lo:400: 00000100:00100000:0.0:1788744246.641263:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744246.641304:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403712 00000100:00100000:0.0:1788744246.641319:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403712 00000100:00100000:0.0:1788744246.641357:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404224 00000100:00100000:0.0:1788744246.641360:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404224 00000100:00100000:0.0:1788744246.641392:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744246.642918:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154403712:12345-0@lo:400: 00000100:00100000:0.0:1788744246.643003:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154403712:12345-0@lo:400: Request processed in 1603us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744246.643014:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744246.643041:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744246.643050:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154404224:12345-0@lo:400: 00000100:00100000:0.0:1788744246.643078:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154404224:12345-0@lo:400: Request processed in 30us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744246.643084:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744246.643111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404096 00000100:00100000:0.0:1788744246.643117:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404096 00000100:00100000:0.0:1788744246.643150:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744246.643156:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154404096:12345-0@lo:400: 00000100:00100000:0.0:1788744246.643191:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154404096:12345-0@lo:400: Request processed in 35us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744246.643197:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744246.643216:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404608 00000100:00100000:0.0:1788744246.643220:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404608 00000100:00100000:0.0:1788744246.643247:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744246.643254:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875634154404608:12345-0@lo:400: 00000100:00100000:0.0:1788744246.643289:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875634154404608:12345-0@lo:400: Request processed in 36us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744246.643296:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788744246.643312:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744246.643325:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744246.643370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154404096:0@lo:400: 00010000:00080000:0.0:1788744246.643386:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac77aaa5500 x1875634154404608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744246.643397:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154404608:0@lo:400: 00000100:00100000:3.0:1788744246.644256:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154403840:0@lo:400: 00000100:00100000:3.0:1788744246.644316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744246.644359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154404352:0@lo:400: 00000100:00100000:3.0:1788744246.644390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744246.644625:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788744246.644632:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154403456:0@lo:13: 00000100:00100000:3.0:1788744246.644657:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744246.644675:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154403968:0@lo:400: 00000100:00100000:3.0:1788744246.644743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744246.644762:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154404480:0@lo:400: 00000100:00100000:3.0:1788744246.644782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744246.644814:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403584 00000100:00100000:3.0:1788744246.644821:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403584 00000100:00100000:3.0:1788744246.644857:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788744246.644864:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3646:x1875634154403584:12345-0@lo:400: 00000100:00100000:3.0:1788744246.644904:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3646:x1875634154403584:12345-0@lo:400: Request processed in 41us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744246.644923:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788744246.644951:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404352 00000100:00100000:3.0:1788744246.644955:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404352 00000100:00100000:3.0:1788744246.644985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403968 00000100:00100000:3.0:1788744246.644988:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403968 00000100:00100000:3.0:1788744246.645002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744246.645007:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154404352:12345-0@lo:400: 00000100:00100000:3.0:1788744246.645043:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154404352:12345-0@lo:400: Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744246.645049:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744246.645061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744246.645067:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154403968:12345-0@lo:400: 00000100:00100000:3.0:1788744246.645103:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154403968:12345-0@lo:400: Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744246.645110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744246.645129:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404480 00000100:00100000:3.0:1788744246.645132:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404480 00000100:00100000:3.0:1788744246.645158:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744246.645166:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154404480:12345-0@lo:400: 00000100:00100000:3.0:1788744246.645192:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154404480:12345-0@lo:400: Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744246.645197:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744246.645228:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403840 00000100:00100000:3.0:1788744246.645232:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403840 00000100:00100000:3.0:1788744246.645256:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744246.645262:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154403840:12345-0@lo:400: 00000100:00100000:3.0:1788744246.645292:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154403840:12345-0@lo:400: Request processed in 30us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744246.645297:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744246.645377:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154403456 00000100:00100000:3.0:1788744246.645381:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154403456 00000100:00100000:3.0:1788744246.645422:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744246.645429:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154403456:12345-0@lo:13: 00002000:00000024:3.0:1788744246.645449:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744246.645478:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154403456:12345-0@lo:13: Request processed in 50us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744246.645483:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788744246.645508:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744246.645511:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788744246.645564:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c1f80 x1875634154403456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744246.645574:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788744246.645594:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154403456:0@lo:13: 00010000:00080000:3.0:1788744246.645609:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c2680 x1875634154403968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744246.645618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154403968:0@lo:400: 00010000:00080000:0.0:1788744246.645626:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c0000 x1875634154403712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788744246.645634:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c0380 x1875634154404480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744246.645644:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154403712:0@lo:400: 00000100:00100000:3.0:1788744246.645650:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154404480:0@lo:400: 00010000:00080000:0.0:1788744246.645664:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c3800 x1875634154404224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744246.645668:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154403840:0@lo:400: 00010000:00080000:3.0:1788744246.645686:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c2300 x1875634154404352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744246.645686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154404224:0@lo:400: 00000100:00100000:3.0:1788744246.645700:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154404352:0@lo:400: 00000100:00100000:0.0:1788744246.645733:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154403584:0@lo:400: 00000001:00080000:3.0:1788744247.152823:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788744247.159853:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154404736:0@lo:13: 00000100:00100000:0.0:1788744247.159930:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744247.160023:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404736 00000100:00100000:1.0:1788744247.160031:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404736 00000100:00100000:1.0:1788744247.160085:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744247.160102:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154404736:12345-0@lo:13: 00002000:00000024:1.0:1788744247.160123:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744247.160344:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154404736:12345-0@lo:13: Request processed in 242us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744247.160351:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744247.160568:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac641b7b800 x1875634154404736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744247.160577:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788744247.160597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154404736:0@lo:13: 00010000:00010000:1.0:1788744247.668609:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744248.178658:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154404864:0@lo:41: 00000100:00100000:3.0:1788744248.178728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744248.178796:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404864 00000100:00100000:3.0:1788744248.178803:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404864 00000100:00100000:3.0:1788744248.178844:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744248.178852:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154404864:12345-0@lo:41: 00000004:00000024:3.0:1788744248.178881:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788744248.178936:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154404864:12345-0@lo:41: Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744248.178954:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744248.178998:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154404864:0@lo:41: 00010000:00010000:1.0:1788744248.689116:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744249.200138:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744249.200166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154404992:0@lo:41: 00000100:00100000:1.0:1788744249.200234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744249.200341:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154404992 00000100:00100000:0.0:1788744249.200350:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154404992 00000100:00100000:0.0:1788744249.200438:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744249.200448:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154404992:12345-0@lo:41: 00000004:00000024:0.0:1788744249.200481:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788744249.200528:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154404992:12345-0@lo:41: Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744249.200563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744249.200611:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154404992:0@lo:41: 00010000:00010000:1.0:1788744249.716653:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744250.734705:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744251.115125:0:9506:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744251.115129:0:9506:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788744251.115131:0:9506:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788744251.115264:0:9506:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ac642271000 00000020:01000004:3.0:1788744251.115278:0:9506:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788744251.115292:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788744251.115304:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ac774904d40) 00000020:00000080:3.0:1788744251.115320:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788744251.147540:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788744251.148196:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788744251.162992:0:9506:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788744251.163197:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788744251.163211:0:9506:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744251.163223:0:9506:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb6207a6e76dcc010 00000020:01000004:2.0:1788744251.163230:0:9506:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788744251.163250:0:9506:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744251.163253:0:9506:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744251.163260:0:9506:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788744251.163288:0:9506:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788744251.163292:0:9506:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788744251.185663:0:9506:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744251.186001:0:9506:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788744251.186006:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744251.186012:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744251.186013:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744251.186014:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744251.186016:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744251.186017:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744251.186019:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744251.186020:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744251.186021:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744251.186022:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744251.186024:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744251.186027:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788744251.186029:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744251.186030:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744251.186031:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744251.186032:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744251.186033:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744251.186034:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744251.186034:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744251.186035:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744251.186036:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744251.186037:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744251.186038:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744251.186072:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744251.186090:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154405120:0@lo:253: 00000100:00100000:2.0:1788744251.186154:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.186267:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744251.186574:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405120 00000100:00100000:0.0:1788744251.186583:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405120 00000100:00100000:0.0:1788744251.186633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788744251.186645:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:9506:x1875634154405120:12345-0@lo:253: 20000000:01000000:0.0:1788744251.186673:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788744251.188498:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788744251.188509:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788744251.188513:0:6511:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788744251.188825:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744251.188969:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788744251.188983:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788744251.189000:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788744251.189007:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788744251.189019:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788744251.189032:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788744251.189105:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788744251.189121:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788744251.189122:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788744251.189136:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788744251.189141:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788744251.189531:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788744251.189540:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788744251.189553:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788744251.189559:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788744251.189569:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788744251.189582:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788744251.189653:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788744251.190612:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788744251.190614:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788744251.190654:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788744251.190660:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788744251.190674:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788744251.190679:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788744251.190693:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788744251.190699:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788744251.190711:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788744251.190727:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788744251.191115:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788744251.191358:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788744251.191360:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788744251.191377:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788744251.191383:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788744251.191396:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788744251.191429:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788744251.191444:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788744251.191450:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788744251.191463:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788744251.191477:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788744251.191490:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788744251.191492:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788744251.191496:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788744251.191536:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788744251.191538:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788744251.195142:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788744251.198566:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788744251.198608:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788744251.198628:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788744251.198644:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788744251.198647:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744251.200636:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744251.200679:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744251.200694:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788744251.201348:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788744251.201379:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788744251.201397:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788744251.201440:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788744251.201442:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788744251.201763:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788744251.201780:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788744251.201796:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788744251.202161:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788744251.202198:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788744251.202212:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788744251.202224:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788744251.202226:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744251.202535:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744251.202561:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744251.202571:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788744251.202699:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788744251.202719:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788744251.202734:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788744251.202744:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788744251.202746:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788744251.203302:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788744251.203322:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788744251.203354:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788744251.203544:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788744251.203564:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788744251.203579:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1788744251.203600:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788744251.203618:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203634:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203642:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203648:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203654:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203661:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203667:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203683:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203691:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203723:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203736:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.203748:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405248:0@lo:104: 00000100:00100000:0.0:1788744251.203800:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744251.203964:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.203973:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 21 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.203981:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405376:0@lo:104: 00000100:00100000:0.0:1788744251.204003:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744251.204037:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.204045:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.204053:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405504:0@lo:104: 00000100:00100000:0.0:1788744251.204081:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744251.204100:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.204108:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 21 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.204116:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405632:0@lo:104: 00000100:00100000:0.0:1788744251.204136:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744251.204152:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.204160:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.204167:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405760:0@lo:104: 00000100:00100000:0.0:1788744251.204186:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744251.204211:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.204219:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.204227:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405888:0@lo:104: 00000100:00100000:0.0:1788744251.204250:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744251.204266:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.204273:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 21 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.204291:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154406016:0@lo:104: 00000100:00100000:0.0:1788744251.204310:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744251.205678:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788744251.205706:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744251.205722:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405248 00000100:00100000:3.0:1788744251.205729:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405248 00000100:00100000:3.0:1788744251.205765:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405376 00000100:00100000:3.0:1788744251.205767:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405376 00000100:00100000:3.0:1788744251.205778:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405504 00000100:00100000:3.0:1788744251.205780:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405504 00000100:00100000:3.0:1788744251.205788:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405632 00000100:00100000:3.0:1788744251.205791:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405632 00000100:00100000:3.0:1788744251.205800:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405760 00000100:00100000:3.0:1788744251.205802:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405760 00000100:00100000:3.0:1788744251.205811:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154405888 00000100:00100000:3.0:1788744251.205824:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154405888 00000100:00100000:3.0:1788744251.205834:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406016 00000100:00100000:3.0:1788744251.205836:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406016 00000100:00100000:3.0:1788744251.205858:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744251.205974:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6511:x1875634154405248:12345-0@lo:104: 00010000:00010000:3.0:1788744251.205988:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.206055:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744251.206061:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:6511:x1875634154405248:12345-0@lo:104: Request processed in 195us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.206067:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744251.206085:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744251.206092:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+8:6511:x1875634154405376:12345-0@lo:104: 00010000:00010000:3.0:1788744251.206099:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.206138:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788744251.206271:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405248:0@lo:104: 00000100:00100000:0.0:1788744251.206280:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405376:0@lo:104: 00000100:00100000:3.0:1788744251.206324:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+8:6511:x1875634154405376:12345-0@lo:104: Request processed in 233us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.206331:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744251.206345:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744251.206350:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+7:6511:x1875634154405504:12345-0@lo:104: 00010000:00010000:3.0:1788744251.206358:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.206458:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405504:0@lo:104: 00010000:00010000:1.0:1788744251.206646:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744251.206654:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.206663:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744251.206674:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.206690:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.206697:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.206702:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744251.206742:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.206748:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744251.206777:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.206846:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154406144:0@lo:103: 00000100:00100000:2.0:1788744251.206903:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744251.206911:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcbffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc002 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.206924:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744251.206927:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.206933:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061ac00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744251.206936:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.206947:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406144 00000100:00100000:2.0:1788744251.206952:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406144 00010000:00010000:1.0:1788744251.206956:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.206971:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 22 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.206973:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.206979:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744251.206984:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744251.206994:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+7:6511:x1875634154405504:12345-0@lo:104: Request processed in 642us (2910us total) trans 0 rc 0/0 00010000:00010000:1.0:1788744251.206995:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.206999:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1788744251.207007:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788744251.207011:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744251.207012:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:3645:x1875634154406144:12345-0@lo:103: 00010000:00010000:1.0:1788744251.207017:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207023:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcbfd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.207026:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788744251.207034:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788744251.207034:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744251.207039:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 22 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207040:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744251.207047:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:6511:x1875634154405632:12345-0@lo:104: 00010000:00010000:1.0:1788744251.207048:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061b600 already unused, calling callback (ffffffffc14dbc20) 00010000:00010000:2.0:1788744251.207053:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 22 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.207054:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.207059:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207063:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.207069:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbffb expref: 22 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.207080:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.207085:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744251.207086:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744251.207105:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207111:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744251.207117:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744251.207124:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3645:x1875634154406144:12345-0@lo:103: Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.207126:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:6511:x1875634154405632:12345-0@lo:104: Request processed in 83us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.207142:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744251.207144:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744251.207163:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744251.207172:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6511:x1875634154405760:12345-0@lo:104: 00010000:00010000:3.0:1788744251.207179:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.207209:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744251.207219:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:6511:x1875634154405760:12345-0@lo:104: Request processed in 50us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.207225:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744251.207239:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744251.207245:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6511:x1875634154405888:12345-0@lo:104: 00010000:00010000:3.0:1788744251.207252:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.207277:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788744251.207282:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6511:x1875634154405888:12345-0@lo:104: Request processed in 38us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.207288:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788744251.207295:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207304:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061b600/0xb6207a6e76dcbfb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.207311:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788744251.207317:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1788744251.207321:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744251.207322:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154406400:0@lo:103: 00010000:00010000:1.0:1788744251.207323:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207330:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031c00 already unused, calling callback (ffffffffc14dbc20) 00000100:00100000:3.0:1788744251.207336:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6511:x1875634154406016:12345-0@lo:104: 10000000:00010000:1.0:1788744251.207337:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.207351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744251.207352:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207352:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.207372:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.207375:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406400 10000000:01000000:1.0:1788744251.207378:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788744251.207379:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406400 00010000:00010000:2.0:1788744251.207394:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207394:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207417:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744251.207422:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1788744251.207427:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744251.207432:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6511:x1875634154406016:12345-0@lo:104: Request processed in 99us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744251.207433:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744251.207444:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3644:x1875634154406400:12345-0@lo:103: 00000100:00100000:3.0:1788744251.207448:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788744251.207451:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcbf8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.207454:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744251.207459:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207463:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744251.207466:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.207469:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207473:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535400 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744251.207476:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.207479:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcbfbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbfb5 expref: 21 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207482:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.207490:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.207492:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1788744251.207495:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744251.207506:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207512:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788744251.207514:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3644:x1875634154406400:12345-0@lo:103: Request processed in 72us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1788744251.207517:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.207521:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788744251.207524:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741535400/0xb6207a6e76dcbf6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207532:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744251.207541:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207547:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744251.207550:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207557:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.207564:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.207569:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744251.207583:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207589:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744251.207593:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207599:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcbf30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf37 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207608:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744251.207611:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207617:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061b400 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744251.207620:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207637:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.207642:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.207645:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744251.207654:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207657:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744251.207661:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207664:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061b400/0xb6207a6e76dcbf06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf0d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.207673:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.207674:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.207675:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.207691:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744251.207698:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154406272:0@lo:103: 00000100:00100000:1.0:1788744251.207717:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.207741:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154406784:0@lo:103: 00000100:00100000:2.0:1788744251.207748:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406272 00000100:00100000:2.0:1788744251.207752:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406272 00010000:00010000:2.0:1788744251.207764:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 20 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744251.207765:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.207788:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744251.207794:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154406656:0@lo:103: 00000100:00100000:1.0:1788744251.207814:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.207910:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406784 00000100:00100000:2.0:1788744251.207915:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406784 00010000:00010000:2.0:1788744251.207928:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744251.207930:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154406912:0@lo:103: 00000100:00100000:2.0:1788744251.207943:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406656 00000100:00100000:2.0:1788744251.207946:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406656 00010000:00010000:2.0:1788744251.207958:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 22 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.207975:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744251.207982:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:3646:x1875634154406272:12345-0@lo:103: 00000100:00100000:0.0:1788744251.207990:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405632:0@lo:104: 00010000:00010000:2.0:1788744251.207991:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744251.207999:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 22 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.208005:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405760:0@lo:104: 00010000:00010000:2.0:1788744251.208012:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 22 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.208017:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154405888:0@lo:104: 00010000:00010000:2.0:1788744251.208030:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcbfd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbfd1 expref: 22 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.208032:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875634154406016:0@lo:104: 00010000:00010000:2.0:1788744251.208048:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744251.208069:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744251.208080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.208085:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3646:x1875634154406272:12345-0@lo:103: Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744251.208092:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744251.208094:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744251.208099:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154406528:0@lo:103: 00000100:00100000:2.0:1788744251.208102:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406912 00000100:00100000:2.0:1788744251.208105:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406912 00010000:00010000:2.0:1788744251.208115:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 21 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744251.208117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.208127:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744251.208133:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3646:x1875634154406784:12345-0@lo:103: 00010000:00010000:2.0:1788744251.208140:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744251.208143:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.208151:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.208161:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741535200/0xb6207a6e76dcbf37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbf30 expref: 21 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.208170:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744251.208191:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3646:x1875634154406784:12345-0@lo:103: Request processed in 58us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744251.208196:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744251.208229:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154406400:0@lo:103: 00000100:00100000:2.0:1788744251.208237:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154406528 00000100:00100000:2.0:1788744251.208240:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154406528 00000100:00100000:3.0:1788744251.208242:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788744251.208255:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 20 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744251.208256:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3646:x1875634154406656:12345-0@lo:103: 00000100:00100000:1.0:1788744251.208264:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154406144:0@lo:103: 00010000:00010000:3.0:1788744251.208271:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744251.208281:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744251.208284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154406272:0@lo:103: 00000100:00100000:2.0:1788744251.208288:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788744251.208296:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154406784:0@lo:103: 00000100:00100000:2.0:1788744251.208297:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788744251.208300:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208321:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcbf76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbf6f expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208331:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744251.208374:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3646:x1875634154406656:12345-0@lo:103: Request processed in 123us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.208381:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744251.208396:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744251.208446:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3643:x1875634154406912:12345-0@lo:103: 00010000:00010000:3.0:1788744251.208456:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744251.208461:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 18 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208469:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 18 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208481:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcbf0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbf06 expref: 18 pid: 6509 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208491:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744251.208523:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3643:x1875634154406912:12345-0@lo:103: Request processed in 79us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.208530:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744251.208549:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744251.208556:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3643:x1875634154406528:12345-0@lo:103: 00000100:00100000:1.0:1788744251.208559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154406912:0@lo:103: 00010000:00010000:3.0:1788744251.208565:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744251.208571:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744251.208586:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154406656:0@lo:103: 00010000:00010000:3.0:1788744251.208588:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208602:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcbf92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbf8b expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208614:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208621:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208632:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208639:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208645:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208651:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208656:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744251.208660:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.208667:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.210449:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.210472:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744251.210509:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.210520:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.210527:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc017 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744251.210538:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154406528:12345-0@lo:103: Request processed in 1980us (2416us total) trans 0 rc 0/0 20000000:01000000:1.0:1788744251.210546:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788744251.210549:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744251.211052:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154406528:0@lo:103: 00000100:00100000:1.0:1788744251.213214:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+14:9506:x1875634154405120:12345-0@lo:253: Request processed in 26565us (27052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.213235:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788744251.213268:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154405120:0@lo:253: 10000000:01000000:2.0:1788744251.213282:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788744251.213286:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744251.213287:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744251.213288:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744251.213289:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788744251.213290:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744251.213291:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744251.213293:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744251.213294:0:9506:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788744251.213296:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744251.213297:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744251.213318:0:9506:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac642271000 from lustre-OST0001 10000000:01000000:2.0:1788744251.213346:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788744251.213349:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744251.213356:0:9506:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac750753380 local copy 10000000:01000000:2.0:1788744251.213359:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744251.213386:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.213393:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.213423:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.213441:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407040:0@lo:101: 00000100:00100000:2.0:1788744251.213475:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.213510:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744251.213762:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407040 00000100:00100000:3.0:1788744251.213771:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407040 00000100:00100000:3.0:1788744251.213814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788744251.213824:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+14:9506:x1875634154407040:12345-0@lo:101: 00010000:00010000:3.0:1788744251.213836:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744251.213863:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac782171800/0xb6207a6e76dcc025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc01e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.213900:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac782171800/0xb6207a6e76dcc025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc01e expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.213912:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac782171800/0xb6207a6e76dcc025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc01e expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744251.213921:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782171800, rc 0) 00000100:00100000:3.0:1788744251.213961:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407040:12345-0@lo:101: Request processed in 139us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.213968:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788744251.213989:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407040:0@lo:101: 00010000:00010000:2.0:1788744251.214004:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.214013:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.214098:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407168:0@lo:501: 00000100:00100000:2.0:1788744251.214196:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.214218:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.214718:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407168 00000100:00100000:1.0:1788744251.214724:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407168 00000100:00100000:1.0:1788744251.214760:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788744251.214766:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407168:12345-0@lo:501: 00000100:00100000:1.0:1788744251.214828:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407168:12345-0@lo:501: Request processed in 61us (631us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744251.214835:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788744251.214919:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407168:0@lo:501: 10000000:01000000:2.0:1788744251.214934:0:9506:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744251.214952:0:9506:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744251.214958:0:9506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.214967:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.214984:0:9506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215004:0:9506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744251.215031:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac642271000 10000000:01000000:2.0:1788744251.215036:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744251.215041:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744251.215043:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744251.215047:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788744251.215055:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788744251.215075:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215082:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215089:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.215103:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407296:0@lo:101: 00010000:00010000:1.0:1788744251.215192:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744251.215198:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.215206:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82400 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744251.215210:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.215218:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.215225:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.215232:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744251.215250:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.215256:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744251.215292:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.215299:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac775b82400/0xb6207a6e76dcc01e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb6207a6e76dcc025 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744251.215316:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154407424:0@lo:103: 00010000:00010000:1.0:1788744251.215321:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.215324:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.215325:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744251.215349:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.215368:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.215428:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407296 00000100:00100000:2.0:1788744251.215433:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407296 00000100:00100000:2.0:1788744251.215464:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788744251.215471:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407296:12345-0@lo:101: 00010000:00010000:2.0:1788744251.215480:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744251.215489:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc02c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215505:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215514:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215521:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82a00, rc 0) 00000100:00100000:2.0:1788744251.215545:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154407296:12345-0@lo:101: Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744251.215550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788744251.215585:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744251.215606:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407296:0@lo:101: 00010000:00010000:2.0:1788744251.215617:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.215625:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.215679:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407552:0@lo:501: 00000100:00100000:2.0:1788744251.215704:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.215727:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.215804:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407424 00000100:00100000:1.0:1788744251.215808:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407424 00000100:00100000:0.0:1788744251.215822:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407552 00000100:00100000:0.0:1788744251.215826:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407552 00000100:00100000:1.0:1788744251.215842:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744251.215849:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3644:x1875634154407424:12345-0@lo:103: 00010000:00010000:1.0:1788744251.215857:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744251.215868:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac782171800/0xb6207a6e76dcc025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc01e expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.215964:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788744251.215973:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154407552:12345-0@lo:501: 00000100:00100000:0.0:1788744251.216064:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154407552:12345-0@lo:501: Request processed in 93us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1788744251.216067:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744251.216071:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788744251.216102:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3644:x1875634154407424:12345-0@lo:103: Request processed in 253us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.216108:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744251.216199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154407424:0@lo:103: 00000100:00100000:2.0:1788744251.216262:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407552:0@lo:501: 00000100:00100000:2.0:1788744251.216288:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407680:0@lo:503: 00000100:00100000:2.0:1788744251.216329:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744251.216444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407680 00000100:00100000:2.0:1788744251.216448:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744251.216449:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407680 00000100:00100000:1.0:1788744251.216499:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788744251.216507:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407680:12345-0@lo:503: 00000100:00100000:1.0:1788744251.216594:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407680:12345-0@lo:503: Request processed in 88us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.216601:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788744251.216646:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407680:0@lo:503: 00000040:00080000:2.0:1788744251.217020:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744251.217073:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407808:0@lo:502: 00000100:00100000:2.0:1788744251.217109:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.217376:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.217444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407808 00000100:00100000:1.0:1788744251.217449:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407808 00000100:00100000:1.0:1788744251.217481:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788744251.217488:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407808:12345-0@lo:502: 00000100:00100000:1.0:1788744251.217728:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407808:12345-0@lo:502: Request processed in 239us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.217741:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744251.217854:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407808:0@lo:502: 00000040:00080000:2.0:1788744251.218070:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788744251.218093:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788744251.218105:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788744251.218114:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788744251.218191:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788744251.218206:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788744251.218238:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407936:0@lo:502: 00000100:00100000:2.0:1788744251.218277:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.218341:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744251.218385:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154407936 00000100:00100000:0.0:1788744251.218390:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154407936 00000100:00100000:0.0:1788744251.218565:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788744251.218575:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407936:12345-0@lo:502: 00000100:00100000:0.0:1788744251.218772:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154407936:12345-0@lo:502: Request processed in 198us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.218780:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744251.218862:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154407936:0@lo:502: 00000040:00080000:2.0:1788744251.218914:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788744251.218921:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788744251.219357:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744251.219365:0:9518:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788744251.219370:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744251.219371:0:9518:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788744251.219375:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744251.219386:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ac77cdf99c0) 00000020:00000080:2.0:1788744251.219547:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788744251.219564:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788744251.219631:0:9518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac642271000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788744251.219637:0:9518:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788744251.219648:0:9518:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb6207a6e76dcc041 00010000:00010000:2.0:1788744251.224242:0:9518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788744251.224656:0:9518:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788744251.227171:0:9518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788744251.227512:0:9518:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788744251.233029:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788744251.233299:0:9518:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788744251.239109:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788744251.241056:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788744251.241065:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744251.241069:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744251.241071:0:9518:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788744251.241074:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744251.241077:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744251.241078:0:9518:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744251.241079:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744251.241081:0:9518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788744251.241098:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744251.241099:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744251.241100:0:9518:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744251.241102:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788744251.241671:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788744251.241702:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788744251.241770:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.241783:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744251.241791:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac642271000 from 1 10000000:01000000:0.0:1788744251.241794:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744251.241829:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.241838:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.241849:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.241872:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408064:0@lo:101: 00000100:00100000:0.0:1788744251.241952:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.241988:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408064 00000100:00100000:0.0:1788744251.241988:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.241996:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408064 00000100:00100000:1.0:1788744251.242039:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788744251.242052:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:9506:x1875634154408064:12345-0@lo:101: 00010000:00010000:1.0:1788744251.242064:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744251.242075:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc048 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.242097:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.242104:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.242111:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c5a00, rc 0) 00000100:00100000:1.0:1788744251.242194:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408064:12345-0@lo:101: Request processed in 143us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.242201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788744251.242228:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408064:0@lo:101: 00010000:00010000:0.0:1788744251.242242:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.242267:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.242349:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408192:0@lo:501: 00000100:00100000:0.0:1788744251.242373:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.242398:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744251.242483:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408192 00000100:00100000:3.0:1788744251.242489:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408192 00000100:00100000:3.0:1788744251.242517:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788744251.242525:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408192:12345-0@lo:501: 00000100:00100000:3.0:1788744251.242618:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408192:12345-0@lo:501: Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.242625:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788744251.242686:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408192:0@lo:501: 00000100:00100000:0.0:1788744251.242712:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408320:0@lo:503: 00000100:00100000:0.0:1788744251.242753:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.242921:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.243022:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408320 00000100:00100000:1.0:1788744251.243026:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408320 00000100:00100000:1.0:1788744251.243051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788744251.243059:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408320:12345-0@lo:503: 00000100:00100000:1.0:1788744251.243778:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408320:12345-0@lo:503: Request processed in 717us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.243787:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788744251.244371:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408320:0@lo:503: 00000040:00080000:0.0:1788744251.244810:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744251.244924:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408448:0@lo:502: 00000100:00100000:0.0:1788744251.244978:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.245013:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.245039:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408448 00000100:00100000:1.0:1788744251.245046:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408448 00000100:00100000:1.0:1788744251.245098:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788744251.245106:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408448:12345-0@lo:502: 00000100:00100000:1.0:1788744251.245198:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408448:12345-0@lo:502: Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.245208:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788744251.245254:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408448:0@lo:502: 00000040:00080000:1.0:1788744251.245503:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788744251.245536:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788744251.245558:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408576:0@lo:502: 00000100:00100000:1.0:1788744251.245594:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.245620:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b9359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744251.245773:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408576 00000100:00100000:0.0:1788744251.245778:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408576 00000100:00100000:0.0:1788744251.245809:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788744251.245861:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408576:12345-0@lo:502: 00000100:00100000:0.0:1788744251.245940:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408576:12345-0@lo:502: Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.245947:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788744251.245969:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408576:0@lo:502: 00000040:00080000:1.0:1788744251.246004:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788744251.246012:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788744251.246523:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744251.246531:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744251.246533:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788744251.246540:0:9522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac642271000 00000020:00000080:1.0:1788744251.246542:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744251.246552:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744251.246555:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744251.246557:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788744251.246559:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788744251.246616:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788744251.246637:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744251.246652:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.246669:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744251.246715:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788744251.246718:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac642271000 10000000:01000000:0.0:1788744251.246720:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac642271000 10000000:01000000:0.0:1788744251.246723:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744251.246726:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac642271000 from 1 10000000:01000000:0.0:1788744251.246728:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744251.246747:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.246752:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.246758:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.246767:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408704:0@lo:101: 00000100:00100000:0.0:1788744251.246792:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.246817:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.246888:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408704 00000100:00100000:1.0:1788744251.246893:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408704 00000100:00100000:1.0:1788744251.246923:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788744251.246929:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:9506:x1875634154408704:12345-0@lo:101: 00010000:00010000:1.0:1788744251.246939:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744251.246955:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc056 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.246976:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.246985:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.246992:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c4600, rc 0) 00000100:00100000:1.0:1788744251.247030:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154408704:12345-0@lo:101: Request processed in 100us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.247036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788744251.247120:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408704:0@lo:101: 00010000:00010000:0.0:1788744251.247132:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.247140:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.247210:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408832:0@lo:501: 00000100:00100000:0.0:1788744251.247232:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.247249:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.247264:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408832 00000100:00100000:1.0:1788744251.247269:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408832 00000100:00100000:1.0:1788744251.247298:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788744251.247304:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154408832:12345-0@lo:501: 00000100:00100000:1.0:1788744251.247395:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154408832:12345-0@lo:501: Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.247418:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788744251.247443:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408832:0@lo:501: 00000100:00100000:2.0:1788744251.247473:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408960:0@lo:503: 00000100:00100000:2.0:1788744251.247510:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.247543:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.247553:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154408960 00000100:00100000:1.0:1788744251.247559:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154408960 00000100:00100000:1.0:1788744251.247584:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788744251.247591:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154408960:12345-0@lo:503: 00000100:00100000:1.0:1788744251.247674:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154408960:12345-0@lo:503: Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.247682:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788744251.247775:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154408960:0@lo:503: 00000040:00080000:2.0:1788744251.247995:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744251.248057:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154409088:0@lo:502: 00000100:00100000:2.0:1788744251.248093:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.248116:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744251.248142:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409088 00000100:00100000:0.0:1788744251.248147:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409088 00000100:00100000:0.0:1788744251.248179:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788744251.248186:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154409088:12345-0@lo:502: 00000100:00100000:0.0:1788744251.248260:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154409088:12345-0@lo:502: Request processed in 75us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.248264:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788744251.248789:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154409088:0@lo:502: 00000040:00080000:2.0:1788744251.248978:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788744251.249006:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788744251.249024:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788744251.249043:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788744251.249061:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788744251.249078:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788744251.249095:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788744251.249106:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788744251.249536:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788744251.249557:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788744251.249568:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788744251.249581:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788744251.249593:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788744251.249603:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788744251.249614:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788744251.249627:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788744251.249656:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788744251.249670:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788744251.249982:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788744251.250002:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788744251.250018:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788744251.250033:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788744251.250050:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788744251.250065:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788744251.250082:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788744251.250114:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788744251.250757:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788744251.250781:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788744251.250800:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788744251.250822:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788744251.250842:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788744251.250864:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788744251.250913:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788744251.250934:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788744251.250957:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788744251.250977:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788744251.250991:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788744251.251008:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788744251.251025:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788744251.251042:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788744251.251056:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788744251.251071:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788744251.251086:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788744251.251101:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788744251.251116:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788744251.251131:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788744251.251176:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154409216:0@lo:502: 00000100:00100000:2.0:1788744251.251251:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.251304:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409216 00000100:00100000:2.0:1788744251.251311:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.251312:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409216 00000100:00100000:1.0:1788744251.251487:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788744251.251498:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154409216:12345-0@lo:502: 00000100:00100000:1.0:1788744251.251611:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154409216:12345-0@lo:502: Request processed in 116us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.251618:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788744251.251944:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154409216:0@lo:502: 00000040:00080000:3.0:1788744251.252720:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788744251.252738:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788744251.253220:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788744251.253245:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ac64323b380) 00000020:00000080:3.0:1788744251.253271:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788744251.253522:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac642271000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788744251.253527:0:9523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac642271000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788744251.253535:0:9523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac642271000 3 00010000:00080000:3.0:1788744251.253560:0:9523:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac776cf3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744251.255289:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788744251.255626:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788744251.255668:0:9523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744251.255685:0:9523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb6207a6e76dcc06b 00000100:00080000:3.0:1788744251.255695:0:9523:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744251.255706:0:9523:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac776cf3800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744251.255743:0:9523:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac774ad7480 x1875634154409344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744251.255771:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744251.255804:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154409344:0@lo:38: 00000100:00100000:3.0:1788744251.255907:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154409472:0@lo:400: 00000100:00100000:1.0:1788744251.256009:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154409600:0@lo:400: 00000100:00100000:0.0:1788744251.259571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744251.259606:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744251.259653:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154409984:0@lo:400: 00000100:00100000:0.0:1788744251.259663:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409344 00000100:00100000:0.0:1788744251.259671:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409344 00000100:00100000:3.0:1788744251.259687:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.259929:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409472 00000100:00100000:0.0:1788744251.259935:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409472 00000100:00100000:0.0:1788744251.259959:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409984 00000100:00100000:0.0:1788744251.259962:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409984 00000100:00100000:0.0:1788744251.259990:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744251.260000:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154409472:12345-0@lo:400: 00000100:00100000:0.0:1788744251.260051:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154409472:12345-0@lo:400: Request processed in 54us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.260059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744251.260078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744251.260090:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154409984:12345-0@lo:400: 00000100:00100000:0.0:1788744251.260122:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154409984:12345-0@lo:400: Request processed in 38us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.260138:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744251.260155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744251.260160:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154409344:12345-0@lo:38: 00010000:00080000:0.0:1788744251.260183:0:6517:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1788744251.260223:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb6207a6e76dcc072 00000004:00100000:0.0:1788744251.260239:0:6517:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744251.260271:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ac775e86800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744251.260318:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875634154409344:12345-0@lo:38: Request processed in 157us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.260325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788744251.260347:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744251.260600:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac774ad7480 x1875634154409344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744251.260612:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744251.260621:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788744251.260629:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744251.260635:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744251.260638:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744251.260645:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154409344:0@lo:38: 00010000:00080000:3.0:1788744251.260694:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac64337c700 x1875634154409984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744251.260706:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154409984:0@lo:400: 00010000:00080000:3.0:1788744251.260720:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac75d4bd180 x1875634154409472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744251.260729:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154409472:0@lo:400: 00000020:01000004:0.0:1788744251.260780:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788744251.260807:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ac6433c0000) 00000020:00000080:0.0:1788744251.260835:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1788744251.260842:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.260875:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154410112:0@lo:400: 00000100:00100000:1.0:1788744251.260916:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788744251.260934:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac642271000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788744251.260940:0:9523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac642271000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788744251.260944:0:9523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac642271000 3 00000100:00100000:1.0:1788744251.260951:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154409728:0@lo:400: 00000100:00100000:1.0:1788744251.260979:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788744251.260994:0:9523:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac6433cb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.104@tcp at head 00000100:00100000:1.0:1788744251.261000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154410240:0@lo:400: 00000100:00100000:1.0:1788744251.261035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.261056:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744251.261062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154409856:0@lo:400: 00000100:00100000:1.0:1788744251.261083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.261100:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154410368:0@lo:400: 00000100:00100000:1.0:1788744251.261117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.261148:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410112 00000100:00100000:1.0:1788744251.261154:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410112 00000100:00100000:1.0:1788744251.261186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409728 00000100:00100000:1.0:1788744251.261190:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409728 00000100:00100000:1.0:1788744251.261209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744251.261217:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154410112:12345-0@lo:400: 00000100:00100000:1.0:1788744251.261255:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154410112:12345-0@lo:400: Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.261271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744251.261284:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744251.261290:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154409728:12345-0@lo:400: 00000100:00100000:1.0:1788744251.261320:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154409728:12345-0@lo:400: Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.261325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744251.261344:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410240 00000100:00100000:1.0:1788744251.261347:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410240 00000100:00100000:1.0:1788744251.261368:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410368 00000100:00100000:1.0:1788744251.261371:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410368 00000100:00100000:3.0:1788744251.262536:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409600 00000100:00100000:3.0:1788744251.262545:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409600 00000100:00100000:3.0:1788744251.262579:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154409856 00000100:00100000:3.0:1788744251.262582:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154409856 00000100:00100000:3.0:1788744251.262596:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744251.262611:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154409600:12345-0@lo:400: 00000100:00100000:3.0:1788744251.262679:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154409600:12345-0@lo:400: Request processed in 70us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.262687:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744251.262707:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744251.262713:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154409856:12345-0@lo:400: 00000100:00100000:3.0:1788744251.262744:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154409856:12345-0@lo:400: Request processed in 32us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.262750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744251.262842:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744251.262851:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154410240:12345-0@lo:400: 00000100:00100000:1.0:1788744251.262897:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154410240:12345-0@lo:400: Request processed in 47us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.262902:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744251.262914:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744251.262920:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154410368:12345-0@lo:400: 00000100:00100000:1.0:1788744251.262947:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154410368:12345-0@lo:400: Request processed in 27us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.262952:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788744251.262975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744251.262979:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744251.263020:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154409856:0@lo:400: 00010000:00080000:1.0:1788744251.263034:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac64337ea00 x1875634154410368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744251.263044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154410368:0@lo:400: 00010000:00080000:1.0:1788744251.263064:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac64337f800 x1875634154409728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744251.263073:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154409728:0@lo:400: 00010000:00080000:1.0:1788744251.263083:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac64337d180 x1875634154410240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744251.263091:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154410240:0@lo:400: 00000100:00100000:1.0:1788744251.263123:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154409600:0@lo:400: 00010000:00080000:1.0:1788744251.263134:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac64337c380 x1875634154410112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744251.263143:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154410112:0@lo:400: 00000100:00100000:1.0:1788744251.263576:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9525:1875634154410496:0@lo:901: 00000100:00100000:1.0:1788744251.263616:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744251.263680:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ad0c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788744251.263856:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788744251.264129:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788744251.264174:0:9523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744251.264185:0:9523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb6207a6e76dcc080 00000100:00080000:0.0:1788744251.264192:0:9523:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744251.264200:0:9523:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ac6433cb000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744251.264236:0:9523:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6424c1500 x1875634154410624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744251.264253:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410496 00000100:00100000:3.0:1788744251.264261:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410496 00000100:00080000:0.0:1788744251.264265:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788744251.264317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744251.264325:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9525:x1875634154410496:12345-0@lo:901: 00000100:00100000:3.0:1788744251.264441:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9525:x1875634154410496:12345-0@lo:901: Request processed in 116us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744251.264448:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744251.264478:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875634154410624:0@lo:38: 00000100:00100000:1.0:1788744251.264521:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788744251.264545:0:9525:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac64337c380 x1875634154410496/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788744267 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788744251.264558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744251.264559:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9525:1875634154410496:0@lo:901: 00000100:00100000:1.0:1788744251.264587:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410624 00000100:00100000:1.0:1788744251.264593:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410624 00000100:00100000:1.0:1788744251.264618:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744251.264624:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154410624:12345-0@lo:38: 00010000:00080000:1.0:1788744251.264645:0:6517:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788744251.264678:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb6207a6e76dcc087 00000004:00100000:1.0:1788744251.264693:0:6517:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744251.264722:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ac77f754000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744251.264771:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875634154410624:12345-0@lo:38: Request processed in 146us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.264779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788744251.264805:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6424c1500 x1875634154410624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744251.264814:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744251.264821:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788744251.264828:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744251.264833:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788744251.264835:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744251.264841:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875634154410624:0@lo:38: 00000040:00080000:0.0:1788744251.265005:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788744251.266088:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788744251.266127:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744251.266148:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.266160:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744251.266219:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744251.266222:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744251.266224:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744251.266225:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744251.266226:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744251.266227:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744251.266228:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744251.266230:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744251.266231:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744251.266233:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744251.266234:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744251.266238:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788744251.266240:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744251.266241:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744251.266242:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744251.266244:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744251.266244:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744251.266245:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744251.266246:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744251.266247:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744251.266248:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744251.266249:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744251.266250:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744251.266268:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744251.266281:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154410752:0@lo:253: 00000100:00100000:2.0:1788744251.266329:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744251.266365:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744251.266382:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410752 00000100:00100000:2.0:1788744251.266388:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410752 00000100:00100000:2.0:1788744251.266447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788744251.266455:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154410752:12345-0@lo:253: 20000000:01000000:2.0:1788744251.266478:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788744251.266491:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788744251.272198:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788744251.272257:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788744251.272268:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744251.272273:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:2.0:1788744251.272563:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:9506:x1875634154410752:12345-0@lo:253: Request processed in 6105us (6229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744251.272574:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:0.0:1788744251.272601:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.272617:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.272633:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.272640:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.272682:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.272694:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.272705:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154410880:0@lo:104: 00000100:00100000:3.0:1788744251.272715:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46c76a72-ee71-482d-9002-d7642a89bcb9:9506:1875634154410752:0@lo:253: 10000000:01000000:3.0:1788744251.272727:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788744251.272730:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744251.272732:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788744251.272733:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744251.272734:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744251.272735:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1788744251.272736:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788744251.272737:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744251.272739:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744251.272740:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744251.272741:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744251.272743:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744251.272745:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788744251.272757:0:9506:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788744251.272776:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.272784:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.272792:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154411008:0@lo:104: 00000100:00100000:0.0:1788744251.272812:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.272835:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744251.272849:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154410880 00000100:00100000:1.0:1788744251.272855:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154410880 00000100:00100000:1.0:1788744251.272896:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411008 00000100:00100000:1.0:1788744251.272899:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411008 00000100:00100000:1.0:1788744251.272915:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744251.272923:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6531:x1875634154410880:12345-0@lo:104: 00010000:00010000:1.0:1788744251.272935:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.272980:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744251.272986:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:6531:x1875634154410880:12345-0@lo:104: Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.272992:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744251.272995:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154410880:0@lo:104: 00000100:00100000:1.0:1788744251.273005:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744251.273011:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154411008:12345-0@lo:104: 00010000:00010000:1.0:1788744251.273019:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.273067:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744251.273072:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:6531:x1875634154411008:12345-0@lo:104: Request processed in 62us (260us total) trans 0 rc 0/0 00010000:00010000:2.0:1788744251.273075:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788744251.273078:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788744251.273081:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.273088:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744251.273092:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.273092:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744251.273099:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744251.273106:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744251.273112:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744251.273196:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.273202:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744251.273216:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744251.273219:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.273222:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.273227:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcbfc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbfca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.273237:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc14dbc20) 00010000:00010000:2.0:1788744251.273239:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744251.273240:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1788744251.273241:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744251.273246:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.273248:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744251.273254:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744251.273259:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788744251.273261:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154411136:0@lo:103: 00010000:00010000:1.0:1788744251.273276:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.273281:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744251.273287:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.273288:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744251.273293:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534c00/0xb6207a6e76dcbf7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.273306:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788744251.273306:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.273307:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.273309:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744251.273311:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154411264:0@lo:103: 00010000:00010000:1.0:1788744251.273313:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744251.273315:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744251.273330:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744251.273841:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411136 00000100:00100000:0.0:1788744251.273847:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411136 00000100:00100000:1.0:1788744251.273930:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411264 00000100:00100000:1.0:1788744251.273935:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411264 00010000:00010000:1.0:1788744251.273958:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 17 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.273972:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 18 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.275587:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744251.275606:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3645:x1875634154411264:12345-0@lo:103: 00010000:00010000:0.0:1788744251.275624:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744251.275631:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 18 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.275645:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 18 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.275665:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744251.275724:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3645:x1875634154411264:12345-0@lo:103: Request processed in 127us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.275926:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744251.275935:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788744251.275991:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcbf84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbf7d expref: 17 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744251.276006:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875634154411008:0@lo:104: 00010000:00010000:0.0:1788744251.276031:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.276522:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154411264:0@lo:103: 00000100:00100000:1.0:1788744251.276659:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3645:x1875634154411136:12345-0@lo:103: 00010000:00010000:1.0:1788744251.276673:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744251.276680:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276691:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276704:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061ae00/0xb6207a6e76dcbfca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbfc3 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276716:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276724:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744251.276745:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009954347s 00010000:00010000:1.0:1788744251.276749:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276756:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276762:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276768:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276786:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744251.276790:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276799:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276824:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744251.276833:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744251.276875:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3645:x1875634154411136:12345-0@lo:103: Request processed in 941us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744251.276891:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788744251.276949:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.276957:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744251.276963:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc08e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744251.277063:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154411136:0@lo:103: 00080000:10000000:3.0:1788744251.278449:0:9506:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788744251.278560:0:9506:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788744251.278677:0:9506:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788744251.278772:0:9506:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788744251.278972:0:9506:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788744251.279139:0:9506:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788744251.286570:0:9506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788744251.296134:0:9506:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788744251.296144:0:9506:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788744251.296182:0:9506:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788744251.296222:0:9506:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788744251.296242:0:9506:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788744251.296259:0:9506:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788744251.297392:0:9506:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744251.297815:0:9506:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1788744251.760461:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154411392:0@lo:13: 00000100:00100000:2.0:1788744251.761113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744251.761528:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744251.762579:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411392 00000100:00100000:0.0:1788744251.762590:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411392 00000100:00100000:0.0:1788744251.762686:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744251.762697:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154411392:12345-0@lo:13: 00002000:00000024:0.0:1788744251.762729:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744251.762800:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154411392:12345-0@lo:13: Request processed in 105us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744251.762807:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788744251.764033:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad7100 x1875634154411392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744251.764056:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154411392:0@lo:13: 00000020:00000004:0.0:1788744252.089282:0:9580:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744252.089528:0:9580:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788744252.274183:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744252.274210:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154411520:0@lo:13: 00000100:00100000:3.0:1788744252.274278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744252.274343:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411520 00000100:00100000:3.0:1788744252.274351:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411520 00000100:00100000:3.0:1788744252.274417:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744252.274426:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154411520:12345-0@lo:13: 00002000:00000024:3.0:1788744252.274449:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744252.274492:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154411520:12345-0@lo:13: Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744252.274499:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788744252.274539:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad7800 x1875634154411520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744252.274556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154411520:0@lo:13: 00010000:00010000:2.0:1788744252.784451:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744253.295602:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154411648:0@lo:41: 00000100:00100000:0.0:1788744253.295662:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744253.296108:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411648 00000100:00100000:3.0:1788744253.296116:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411648 00000100:00100000:3.0:1788744253.296162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744253.296170:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154411648:12345-0@lo:41: 00000004:00000024:3.0:1788744253.296198:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788744253.296248:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154411648:12345-0@lo:41: Request processed in 79us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744253.296254:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744253.296337:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154411648:0@lo:41: 00010000:00010000:1.0:1788744253.806817:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744254.318784:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154411776:0@lo:41: 00000100:00100000:0.0:1788744254.318876:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744254.318953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411776 00000100:00100000:0.0:1788744254.318961:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411776 00000100:00100000:0.0:1788744254.319010:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744254.319024:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154411776:12345-0@lo:41: 00000004:00000024:0.0:1788744254.319062:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788744254.319117:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154411776:12345-0@lo:41: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744254.319127:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744254.319265:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154411776:0@lo:41: 00010000:00010000:3.0:1788744254.830819:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744255.861653:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744256.376642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154411904:0@lo:400: 00000100:00100000:3.0:1788744256.376711:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744256.376757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154412416:0@lo:400: 00000100:00100000:3.0:1788744256.376785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744256.376811:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788744256.376817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154412032:0@lo:400: 00000100:00100000:3.0:1788744256.376840:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744256.376869:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154412544:0@lo:400: 00000100:00100000:3.0:1788744256.376890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744256.376922:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154411904 00000100:00100000:3.0:1788744256.376929:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154411904 00000100:00100000:3.0:1788744256.376972:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788744256.376980:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154411904:12345-0@lo:400: 00000100:00100000:3.0:1788744256.377039:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154411904:12345-0@lo:400: Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.377045:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788744256.377074:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412416 00000100:00100000:3.0:1788744256.377084:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412416 00000100:00100000:3.0:1788744256.377109:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744256.377115:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154412416:12345-0@lo:400: 00000100:00100000:3.0:1788744256.377146:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154412416:12345-0@lo:400: Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.377152:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744256.377286:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412032 00000100:00100000:3.0:1788744256.377289:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412032 00000100:00100000:3.0:1788744256.377312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412544 00000100:00100000:3.0:1788744256.377314:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412544 00000100:00100000:3.0:1788744256.377337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744256.377343:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154412032:12345-0@lo:400: 00000100:00100000:3.0:1788744256.377372:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154412032:12345-0@lo:400: Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.377378:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744256.377390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744256.377395:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154412544:12345-0@lo:400: 00000100:00100000:3.0:1788744256.377445:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154412544:12345-0@lo:400: Request processed in 49us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.377451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788744256.377476:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744256.377504:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b45880 x1875634154412032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744256.377519:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154412032:0@lo:400: 00010000:00080000:3.0:1788744256.377530:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b45500 x1875634154412544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744256.377538:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154412544:0@lo:400: 00000100:00100000:3.0:1788744256.377557:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154411904:0@lo:400: 00000100:00100000:3.0:1788744256.377567:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154412416:0@lo:400: 00000100:00100000:2.0:1788744256.377684:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154413056:0@lo:400: 00000100:00100000:2.0:1788744256.377716:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.377733:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744256.377738:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154412928:0@lo:400: 00000100:00100000:2.0:1788744256.377760:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.377785:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154412160:0@lo:400: 00000100:00100000:2.0:1788744256.377819:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.377837:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154412672:0@lo:400: 00000100:00100000:2.0:1788744256.377871:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.377883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154413184:0@lo:400: 00000100:00100000:2.0:1788744256.377915:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.377930:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788744256.377936:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154412288:0@lo:400: 00000100:00100000:2.0:1788744256.377955:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.377967:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154412800:0@lo:400: 00000100:00100000:2.0:1788744256.377985:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744256.378028:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412928 00000100:00100000:2.0:1788744256.378033:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412928 00000100:00100000:2.0:1788744256.378060:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412800 00000100:00100000:2.0:1788744256.378063:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412800 00000100:00100000:2.0:1788744256.378080:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744256.378086:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154412928:12345-0@lo:400: 00000100:00100000:2.0:1788744256.378118:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154412928:12345-0@lo:400: Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744256.378124:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744256.378136:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744256.378142:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154412800:12345-0@lo:400: 00000100:00100000:3.0:1788744256.379189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412160 00000100:00100000:3.0:1788744256.379198:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412160 00000100:00100000:3.0:1788744256.379237:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744256.379245:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154412160:12345-0@lo:400: 00000100:00100000:3.0:1788744256.379297:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154412160:12345-0@lo:400: Request processed in 53us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.379302:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744256.379325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413056 00000100:00100000:3.0:1788744256.379328:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413056 00000100:00100000:3.0:1788744256.379345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412672 00000100:00100000:3.0:1788744256.379347:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412672 00000100:00100000:3.0:1788744256.379358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413184 00000100:00100000:3.0:1788744256.379361:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413184 00000100:00100000:3.0:1788744256.379371:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154412288 00000100:00100000:3.0:1788744256.379374:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154412288 00000100:00100000:3.0:1788744256.379385:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744256.379390:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154413056:12345-0@lo:400: 00000100:00100000:3.0:1788744256.379434:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154413056:12345-0@lo:400: Request processed in 44us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.379440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744256.379451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744256.379457:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154412672:12345-0@lo:400: 00000100:00100000:3.0:1788744256.379500:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154412672:12345-0@lo:400: Request processed in 43us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.379506:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744256.379522:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744256.379527:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154413184:12345-0@lo:400: 00000100:00100000:3.0:1788744256.379553:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154413184:12345-0@lo:400: Request processed in 26us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.379558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744256.379567:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744256.379573:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154412288:12345-0@lo:400: 00000100:00100000:3.0:1788744256.379597:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154412288:12345-0@lo:400: Request processed in 24us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744256.379602:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788744256.379621:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744256.379624:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744256.379626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744256.379757:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154412800:12345-0@lo:400: Request processed in 28us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744256.379764:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788744256.379815:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44a80 x1875634154412928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744256.379828:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154412928:0@lo:400: 00010000:00080000:2.0:1788744256.379839:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44700 x1875634154413056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744256.379856:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154413056:0@lo:400: 00010000:00080000:2.0:1788744256.379900:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b45c00 x1875634154412288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744256.379908:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154412288:0@lo:400: 00010000:00080000:2.0:1788744256.379917:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b45f80 x1875634154412800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744256.379925:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154412800:0@lo:400: 00000100:00100000:2.0:1788744256.379933:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154412160:0@lo:400: 00010000:00080000:2.0:1788744256.379941:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b46300 x1875634154412672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744256.379948:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154412672:0@lo:400: 00010000:00080000:2.0:1788744256.379957:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44000 x1875634154413184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744256.379964:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154413184:0@lo:400: 00000001:02000400:1.0:1788744256.750893:0:9870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744256.878685:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744256.882027:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154413312:0@lo:13: 00000100:00100000:0.0:1788744256.882087:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744256.882169:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413312 00000100:00100000:1.0:1788744256.882176:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413312 00000100:00100000:1.0:1788744256.882219:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744256.882227:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154413312:12345-0@lo:13: 00002000:00000024:1.0:1788744256.882251:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744256.884777:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154413312:12345-0@lo:13: Request processed in 2542us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744256.884788:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788744256.884884:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77aaa5500 x1875634154413312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744256.884906:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154413312:0@lo:13: 00000100:00100000:2.0:1788744257.401715:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744257.401754:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154413440:0@lo:13: 00000100:00100000:2.0:1788744257.401826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744257.401959:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413440 00000100:00100000:1.0:1788744257.401969:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413440 00000100:00100000:1.0:1788744257.402085:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744257.402097:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154413440:12345-0@lo:13: 00002000:00000024:1.0:1788744257.402129:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744257.402380:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154413440:12345-0@lo:13: Request processed in 284us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744257.402534:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788744257.402973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f2300 x1875634154413440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744257.403004:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154413440:0@lo:13: 00000020:00000004:2.0:1788744257.864163:0:9922:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744257.865042:0:9922:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788744257.907670:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744258.414920:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744258.414948:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154413568:0@lo:41: 00000100:00100000:3.0:1788744258.415019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744258.415560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413568 00000100:00100000:0.0:1788744258.415569:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413568 00000100:00100000:0.0:1788744258.415620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788744258.415629:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154413568:12345-0@lo:41: 00000004:00000024:0.0:1788744258.415662:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788744258.415721:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154413568:12345-0@lo:41: Request processed in 93us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744258.415728:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788744258.415868:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154413568:0@lo:41: 00010000:00010000:0.0:1788744258.927156:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744259.438928:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744259.438960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154413696:0@lo:41: 00000100:00100000:1.0:1788744259.439028:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744259.445616:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413696 00000100:00100000:3.0:1788744259.445632:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413696 00000100:00100000:3.0:1788744259.445706:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744259.445716:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154413696:12345-0@lo:41: 00000004:00000024:3.0:1788744259.445887:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788744259.447302:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154413696:12345-0@lo:41: Request processed in 1580us (8267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744259.447314:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744259.447453:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154413696:0@lo:41: 00010000:00010000:0.0:1788744259.950705:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744260.974733:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744260.975017:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744260.975021:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac77c9d5000 from 39 10000000:01000000:0.0:1788744260.975027:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744260.975075:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744260.975087:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744260.975098:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744260.975128:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154413824:0@lo:101: 00000100:00100000:0.0:1788744260.975191:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.975235:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac744d9d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744260.977888:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413824 00000100:00100000:2.0:1788744260.977903:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413824 00000100:00100000:2.0:1788744260.977971:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788744260.977981:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154413824:12345-0@lo:101: 00010000:00010000:2.0:1788744260.978004:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744260.978022:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc095 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744260.978047:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744260.978071:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744260.978081:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82400, rc 0) 00000100:00100000:2.0:1788744260.978154:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154413824:12345-0@lo:101: Request processed in 174us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744260.978161:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788744260.978256:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154413824:0@lo:101: 00010000:00010000:0.0:1788744260.978274:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744260.978284:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744260.978350:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154413952:0@lo:501: 00000100:00100000:0.0:1788744260.978382:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.978443:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac744d9d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744260.978644:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154413952 00000100:00100000:3.0:1788744260.978649:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154413952 00000100:00100000:3.0:1788744260.978718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788744260.978727:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154413952:12345-0@lo:501: 00000100:00100000:3.0:1788744260.978866:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154413952:12345-0@lo:501: Request processed in 140us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744260.978874:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788744260.982060:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154413952:0@lo:501: 00000100:00100000:0.0:1788744260.982116:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414080:0@lo:503: 00000100:00100000:0.0:1788744260.982177:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.982209:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac744d9d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744260.982225:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414080 00000100:00100000:0.0:1788744260.982230:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414080 00000100:00100000:0.0:1788744260.982262:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788744260.982269:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154414080:12345-0@lo:503: 00000100:00100000:0.0:1788744260.982364:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154414080:12345-0@lo:503: Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744260.982485:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788744260.982526:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414080:0@lo:503: 00000100:00100000:0.0:1788744260.982676:0:10021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10021:1875634154414208:0@lo:502: 00000100:00100000:0.0:1788744260.982706:0:10021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.982722:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414208 00000100:00100000:0.0:1788744260.982726:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414208 00000100:00100000:0.0:1788744260.982740:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744260.982746:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10021:x1875634154414208:12345-0@lo:502: 00000100:00100000:0.0:1788744260.982807:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10021:x1875634154414208:12345-0@lo:502: Request processed in 61us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744260.982826:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744260.982855:0:10021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744260.982865:0:10021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10021:1875634154414208:0@lo:502: 00000100:00100000:0.0:1788744260.982901:0:10021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10021:1875634154414336:0@lo:502: 00000100:00100000:0.0:1788744260.982931:0:10021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.982949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414336 00000100:00100000:0.0:1788744260.982952:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414336 00000100:00100000:0.0:1788744260.982968:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744260.982974:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10021:x1875634154414336:12345-0@lo:502: 00000100:00100000:0.0:1788744260.983023:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10021:x1875634154414336:12345-0@lo:502: Request processed in 48us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744260.983029:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744260.983049:0:10021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744260.983128:0:10021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10021:1875634154414336:0@lo:502: 00000040:00080000:0.0:1788744260.983147:0:10021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788744260.983199:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788744260.983219:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744260.983233:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744260.983243:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744260.983252:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788744260.983254:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788744260.983257:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744260.983279:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744260.983287:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744260.983296:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744260.983307:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414464:0@lo:101: 00000100:00100000:0.0:1788744260.983333:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.983346:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744260.983357:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414464 00000100:00100000:0.0:1788744260.983360:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414464 00000100:00100000:3.0:1788744260.983656:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788744260.983667:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154414464:12345-0@lo:101: 00010000:00010000:3.0:1788744260.983676:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744260.983690:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc0a3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.983711:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.983722:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.983730:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170a00, rc 0) 00000100:00100000:3.0:1788744260.983809:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154414464:12345-0@lo:101: Request processed in 145us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744260.983829:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788744260.983934:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414464:0@lo:101: 00010000:00010000:3.0:1788744260.983946:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.983954:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744260.984005:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414592:0@lo:501: 00000100:00100000:3.0:1788744260.984039:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744260.984165:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414592 00000100:00100000:0.0:1788744260.984170:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414592 00000100:00100000:0.0:1788744260.984189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788744260.984196:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154414592:12345-0@lo:501: 00000100:00100000:0.0:1788744260.984288:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154414592:12345-0@lo:501: Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744260.984294:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788744260.985490:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744260.985520:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414592:0@lo:501: 00000100:00100000:3.0:1788744260.985560:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414720:0@lo:503: 00000100:00100000:3.0:1788744260.985612:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744260.985678:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744260.989058:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414720 00000100:00100000:0.0:1788744260.989072:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414720 00000100:00100000:0.0:1788744260.989126:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788744260.989136:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154414720:12345-0@lo:503: 00000100:00100000:0.0:1788744260.989284:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154414720:12345-0@lo:503: Request processed in 150us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744260.989290:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788744260.989758:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154414720:0@lo:503: 00000100:00100000:1.0:1788744260.990806:0:10023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10023:1875634154414848:0@lo:502: 00000100:00100000:1.0:1788744260.990889:0:10023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744260.990974:0:10023:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744260.992571:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414848 00000100:00100000:3.0:1788744260.992582:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414848 00000100:00100000:3.0:1788744260.992635:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788744260.992645:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10023:x1875634154414848:12345-0@lo:502: 00000100:00100000:3.0:1788744260.992794:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10023:x1875634154414848:12345-0@lo:502: Request processed in 149us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744260.992801:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788744260.994705:0:10023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10023:1875634154414848:0@lo:502: 00000020:01000000:1.0:1788744260.994746:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744260.994755:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744260.994757:0:10023:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744260.994762:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744260.994764:0:10023:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788744260.994792:0:10023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10023:1875634154414976:0@lo:502: 00000100:00100000:1.0:1788744260.994860:0:10023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744260.994899:0:10023:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744260.994916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154414976 00000100:00100000:3.0:1788744260.994923:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154414976 00000100:00100000:3.0:1788744260.994971:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788744260.994980:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10023:x1875634154414976:12345-0@lo:502: 00000100:00100000:3.0:1788744260.995096:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10023:x1875634154414976:12345-0@lo:502: Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744260.995103:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788744260.995240:0:10023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10023:1875634154414976:0@lo:502: 00000020:01000000:1.0:1788744260.995258:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744260.995263:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744260.995269:0:10023:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788744260.995273:0:10023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788744260.995794:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788744260.995827:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788744260.995837:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.995848:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744260.995868:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744260.995870:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac774b65800 from 39 10000000:01000000:3.0:1788744260.995873:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744260.995899:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.995907:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744260.995916:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744260.995928:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415104:0@lo:101: 00000100:00100000:3.0:1788744260.995961:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744260.995993:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744260.996032:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415104 00000100:00100000:1.0:1788744260.996037:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415104 00000100:00100000:1.0:1788744260.996159:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788744260.996167:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154415104:12345-0@lo:101: 00010000:00010000:1.0:1788744260.996177:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744260.996187:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc0b1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744260.996206:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744260.996216:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744260.996224:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c4c00, rc 0) 00000100:00100000:1.0:1788744260.996261:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154415104:12345-0@lo:101: Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744260.996267:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744260.996323:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415104:0@lo:101: 00010000:00010000:2.0:1788744260.996335:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744260.996343:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744260.996391:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415232:0@lo:501: 00000100:00100000:2.0:1788744260.996434:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.002146:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415232 00000100:00100000:3.0:1788744261.002157:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415232 00000100:00100000:3.0:1788744261.002201:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788744261.002210:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154415232:12345-0@lo:501: 00000100:00100000:3.0:1788744261.002344:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154415232:12345-0@lo:501: Request processed in 134us (5908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.002351:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788744261.003557:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8d80 going to sleep for 10 seconds 00000100:00100000:3.0:1788744261.003589:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415232:0@lo:501: 00000100:00100000:3.0:1788744261.003640:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415360:0@lo:503: 00000100:00100000:3.0:1788744261.003702:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.003741:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.003795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415360 00000100:00100000:1.0:1788744261.003802:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415360 00000100:00100000:1.0:1788744261.003852:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788744261.003860:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154415360:12345-0@lo:503: 00000100:00100000:1.0:1788744261.003949:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154415360:12345-0@lo:503: Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.003957:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744261.004037:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415360:0@lo:503: 00000100:00100000:3.0:1788744261.004514:0:10024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10024:1875634154415488:0@lo:502: 00000100:00100000:3.0:1788744261.004553:0:10024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.004579:0:10024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.004624:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415488 00000100:00100000:1.0:1788744261.004629:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415488 00000100:00100000:1.0:1788744261.004664:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788744261.004670:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10024:x1875634154415488:12345-0@lo:502: 00000100:00100000:1.0:1788744261.004742:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10024:x1875634154415488:12345-0@lo:502: Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.004749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788744261.004833:0:10024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10024:1875634154415488:0@lo:502: 00000100:00100000:3.0:1788744261.004874:0:10024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10024:1875634154415616:0@lo:502: 00000100:00100000:3.0:1788744261.004904:0:10024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.004928:0:10024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.004973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415616 00000100:00100000:1.0:1788744261.004977:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415616 00000100:00100000:1.0:1788744261.005003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788744261.005009:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10024:x1875634154415616:12345-0@lo:502: 00000100:00100000:1.0:1788744261.005083:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10024:x1875634154415616:12345-0@lo:502: Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.005090:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788744261.005220:0:10024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10024:1875634154415616:0@lo:502: 00000040:00080000:3.0:1788744261.005238:0:10024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788744261.005534:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788744261.005558:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744261.005568:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.005580:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744261.005589:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744261.005592:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac774b65800 from 6 10000000:01000000:1.0:1788744261.005594:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744261.005622:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.005630:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.005649:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744261.005662:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415744:0@lo:101: 00000100:00100000:1.0:1788744261.005692:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.005754:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744261.008963:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415744 00000100:00100000:0.0:1788744261.008979:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415744 00000100:00100000:3.0:1788744261.010515:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788744261.010794:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154415744:12345-0@lo:101: 00010000:00010000:2.0:1788744261.010812:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744261.010846:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83e00/0xb6207a6e76dcc0c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc0bf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.010883:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83e00/0xb6207a6e76dcc0c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0bf expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.010895:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83e00/0xb6207a6e76dcc0c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0bf expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.010904:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83e00, rc 0) 00000100:00100000:2.0:1788744261.010987:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154415744:12345-0@lo:101: Request processed in 461us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.010994:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788744261.011502:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415744:0@lo:101: 00010000:00010000:3.0:1788744261.011521:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.011530:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.011593:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415872:0@lo:256: 00000100:00100000:3.0:1788744261.011631:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.011666:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.012671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154415872 00000100:00100000:2.0:1788744261.012680:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154415872 00000100:00100000:2.0:1788744261.012721:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788744261.012729:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154415872:12345-0@lo:256: 20000000:01000000:2.0:1788744261.012748:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744261.012763:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744261.012767:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788744261.012867:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154415872:12345-0@lo:256: Request processed in 138us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.012874:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788744261.012905:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154415872:0@lo:256: 10000000:01000000:3.0:1788744261.012954:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744261.012963:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.012976:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744261.012986:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788744261.012988:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788744261.012991:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788744261.013016:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.013024:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.013033:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.013045:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154416000:0@lo:101: 00000100:00100000:3.0:1788744261.013143:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.013175:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.013372:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416000 00000100:00100000:2.0:1788744261.013378:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416000 00000100:00100000:2.0:1788744261.013425:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788744261.013432:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154416000:12345-0@lo:101: 00010000:00010000:2.0:1788744261.013440:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744261.013450:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc0cd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.013478:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.013488:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.013495:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83800, rc 0) 00000100:00100000:2.0:1788744261.013529:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154416000:12345-0@lo:101: Request processed in 98us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.013535:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788744261.013855:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154416000:0@lo:101: 00010000:00010000:3.0:1788744261.013867:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.013876:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.013925:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154416128:0@lo:501: 00000100:00100000:3.0:1788744261.013949:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.013976:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.014102:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416128 00000100:00100000:2.0:1788744261.014106:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416128 00000100:00100000:2.0:1788744261.014135:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788744261.014142:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154416128:12345-0@lo:501: 00000100:00100000:2.0:1788744261.014257:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154416128:12345-0@lo:501: Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.014265:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788744261.014468:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154416128:0@lo:501: 00000100:00100000:3.0:1788744261.014498:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154416256:0@lo:503: 00000100:00100000:3.0:1788744261.014531:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.014553:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.016068:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416256 00000100:00100000:2.0:1788744261.016080:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416256 00000100:00100000:2.0:1788744261.016135:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788744261.016145:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154416256:12345-0@lo:503: 00000100:00100000:2.0:1788744261.016282:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154416256:12345-0@lo:503: Request processed in 138us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.016290:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788744261.016484:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154416256:0@lo:503: 00000100:00100000:1.0:1788744261.018322:0:10028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10028:1875634154416384:0@lo:502: 00000100:00100000:1.0:1788744261.018392:0:10028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.018451:0:10028:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.020657:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416384 00000100:00100000:2.0:1788744261.020668:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416384 00000100:00100000:2.0:1788744261.020728:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788744261.020747:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10028:x1875634154416384:12345-0@lo:502: 00000100:00100000:2.0:1788744261.021029:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10028:x1875634154416384:12345-0@lo:502: Request processed in 282us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.021037:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788744261.021106:0:10028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10028:1875634154416384:0@lo:502: 00000020:01000000:1.0:1788744261.021139:0:10028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744261.021146:0:10028:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788744261.021153:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744261.021155:0:10028:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788744261.021160:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744261.021163:0:10028:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1788744261.021183:0:10028:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788744261.021186:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744261.021199:0:10028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ac77c9bb380) 00000020:00000080:1.0:1788744261.021221:0:10028:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788744261.021226:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744261.021318:0:10028:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788744261.021325:0:10028:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788744261.021333:0:10028:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcc0e2 00010000:00080000:1.0:1788744261.021359:0:10028:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac6426d5000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744261.021629:0:10028:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788744261.021751:0:10028:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788744261.021762:0:10028:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788744261.021923:0:10028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744261.022014:0:10028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744261.022137:0:10028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788744261.022221:0:10028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788744261.026743:0:10029:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744261.026752:0:10029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788744261.031476:0:10028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744261.031490:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744261.031529:0:10028:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788744261.031553:0:10028:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcc0e9 00000100:00080000:1.0:1788744261.031563:0:10028:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744261.031575:0:10028:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ac6426d5000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744261.031609:0:10028:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac64337d880 x1875634154416512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744261.031642:0:10028:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788744261.031688:0:10028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744261.031692:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744261.031694:0:10028:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788744261.031697:0:10028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744261.031700:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744261.031702:0:10028:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744261.031705:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744261.031707:0:10028:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788744261.031716:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154416512:0@lo:8: 00000100:00100000:1.0:1788744261.031728:0:10028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10028:1875634154416640:0@lo:502: 00000100:00100000:3.0:1788744261.031905:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154416768:0@lo:400: 00000020:00000004:0.0:1788744261.032097:0:10027:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1788744261.032181:0:10028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032215:0:10028:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c0c0 going to sleep for 11 seconds 00000020:00000004:0.0:1788744261.032378:0:10027:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788744261.032474:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154416896:0@lo:400: 00000100:00100000:1.0:1788744261.032505:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154417408:0@lo:400: 00000100:00100000:1.0:1788744261.032556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154417920:0@lo:400: 00000100:00100000:1.0:1788744261.032590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032609:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744261.032615:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154417024:0@lo:400: 00000100:00100000:1.0:1788744261.032635:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032652:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154417536:0@lo:400: 00000100:00100000:1.0:1788744261.032672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032698:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154417152:0@lo:400: 00000100:00100000:1.0:1788744261.032721:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.032744:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154417664:0@lo:400: 00000100:00100000:1.0:1788744261.032775:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744261.033063:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416896 00000100:00100000:0.0:1788744261.033071:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416896 00000100:00100000:0.0:1788744261.033114:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417152 00000100:00100000:0.0:1788744261.033117:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417152 00000100:00100000:0.0:1788744261.033133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744261.033360:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154416896:12345-0@lo:400: 00000100:00100000:0.0:1788744261.033444:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154416896:12345-0@lo:400: Request processed in 302us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.033451:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744261.033466:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744261.033473:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154417152:12345-0@lo:400: 00000100:00100000:0.0:1788744261.033506:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154417152:12345-0@lo:400: Request processed in 34us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.033512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744261.034718:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154417152:0@lo:400: 00000100:00100000:0.0:1788744261.034767:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154416896:0@lo:400: 00000100:00100000:2.0:1788744261.035503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.036688:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417536 00000100:00100000:2.0:1788744261.036700:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417536 00000100:00100000:2.0:1788744261.036762:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417664 00000100:00100000:2.0:1788744261.036765:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417664 00000100:00100000:2.0:1788744261.036779:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416512 00000100:00100000:2.0:1788744261.036783:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416512 00000100:00100000:2.0:1788744261.036796:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744261.036805:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154417536:12345-0@lo:400: 00000100:00100000:2.0:1788744261.036896:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154417536:12345-0@lo:400: Request processed in 92us (4223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.036903:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744261.036920:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744261.036926:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154417664:12345-0@lo:400: 00000100:00100000:2.0:1788744261.036957:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154417664:12345-0@lo:400: Request processed in 32us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.036962:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744261.036973:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744261.036977:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875634154416512:12345-0@lo:8: 00010000:00080000:2.0:1788744261.037002:0:8431:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1788744261.037028:0:8431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcc0f0 00002000:00100000:2.0:1788744261.037040:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ac6427dc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788744261.037053:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788744261.037057:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788744261.037115:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1788744261.037730:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a4700 x1875634154417664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744261.037751:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154417664:0@lo:400: 00010000:00080000:0.0:1788744261.037783:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a6300 x1875634154417536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744261.037792:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154417536:0@lo:400: 00002000:00080000:2.0:1788744261.038769:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788744261.038799:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ac6427de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744261.038885:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875634154416512:12345-0@lo:8: Request processed in 1905us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.038894:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788744261.038916:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337d880 x1875634154416512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.038925:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744261.038932:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788744261.038939:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788744261.038944:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788744261.038946:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac6426d5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788744261.038958:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788744261.038963:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154416512:0@lo:8: 00000004:00080000:1.0:1788744261.038984:0:10029:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788744261.039038:0:10029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 242720635736ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788744261.039044:0:10029:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788744261.039318:0:10030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154418048:0@lo:700: 00000100:00100000:1.0:1788744261.039364:0:10030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.039421:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418048 00000100:00100000:1.0:1788744261.039427:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418048 00000100:00100000:1.0:1788744261.039466:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744261.039473:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10030:x1875634154418048:12345-0@lo:700: 00000100:00100000:1.0:1788744261.039501:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875634154418176:0@lo:700: 00000100:00100000:1.0:1788744261.039528:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.039548:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.039559:0:10030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c300 going to sleep for 11 seconds 00000100:00080000:3.0:1788744261.039837:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744261.039842:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744261.039860:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416640 00000100:00100000:3.0:1788744261.039864:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416640 00000100:00100000:3.0:1788744261.039952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788744261.039960:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10028:x1875634154416640:12345-0@lo:502: 00000100:00100000:2.0:1788744261.040255:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418176 00000100:00100000:2.0:1788744261.040260:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418176 00000100:00100000:3.0:1788744261.040295:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10028:x1875634154416640:12345-0@lo:502: Request processed in 335us (8113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.040302:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788744261.040344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417408 00000100:00100000:3.0:1788744261.040348:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417408 00000100:00100000:2.0:1788744261.040397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744261.040419:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875634154418176:12345-0@lo:700: 00000100:00100000:1.0:1788744261.043266:0:10028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10028:1875634154416640:0@lo:502: 00000020:01000000:1.0:1788744261.043367:0:10028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744261.043386:0:10028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744261.043389:0:10028:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788744261.043394:0:10028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1788744261.044197:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417920 00000100:00100000:3.0:1788744261.044205:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417920 00000100:00100000:3.0:1788744261.044222:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417024 00000100:00100000:3.0:1788744261.044224:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417024 00000100:00100000:3.0:1788744261.044240:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744261.044248:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154417408:12345-0@lo:400: 00000100:00100000:3.0:1788744261.044381:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154417408:12345-0@lo:400: Request processed in 126us (11816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.044388:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744261.044417:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744261.044423:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154417920:12345-0@lo:400: 00000100:00100000:3.0:1788744261.044461:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154417920:12345-0@lo:400: Request processed in 39us (11869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.044467:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744261.044477:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744261.044483:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154417024:12345-0@lo:400: 00000100:00100000:3.0:1788744261.044505:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154417024:12345-0@lo:400: Request processed in 23us (11869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.044510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000020:01000000:3.0:1788744261.044576:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788744261.044599:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788744261.044608:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.044618:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744261.044628:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744261.044630:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac75196e800 from 39 10000000:01000000:3.0:1788744261.044633:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744261.044659:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.044666:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.044676:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.044692:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418304:0@lo:101: 00000100:00100000:3.0:1788744261.044730:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.044754:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.044774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.044792:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154416768 00000100:00100000:3.0:1788744261.044795:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154416768 00000100:00100000:3.0:1788744261.044826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744261.044833:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154416768:12345-0@lo:400: 00000100:00100000:3.0:1788744261.044861:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154416768:12345-0@lo:400: Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.044865:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788744261.044893:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bd180 x1875634154416768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744261.044905:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154416768:0@lo:400: 00000100:00100000:3.0:1788744261.044912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154417280:0@lo:400: 00000100:00100000:3.0:1788744261.044933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.044950:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417280 00000100:00100000:3.0:1788744261.044953:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417280 00000100:00100000:3.0:1788744261.044976:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788744261.044981:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154417280:12345-0@lo:400: 00000100:00100000:3.0:1788744261.045008:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154417280:12345-0@lo:400: Request processed in 27us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.045014:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788744261.045039:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a7480 x1875634154417280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744261.045048:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154417280:0@lo:400: 00000100:00100000:2.0:1788744261.045351:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418304 00000100:00100000:2.0:1788744261.045356:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418304 00000100:00100000:2.0:1788744261.045391:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788744261.045416:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154418304:12345-0@lo:101: 00010000:00010000:2.0:1788744261.045427:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744261.045441:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc0f7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.045461:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.045472:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.045479:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83600, rc 0) 00000100:00100000:2.0:1788744261.045511:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154418304:12345-0@lo:101: Request processed in 113us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.045524:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788744261.045865:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418304:0@lo:101: 00010000:00010000:2.0:1788744261.045879:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744261.045887:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744261.045952:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418432:0@lo:501: 00000100:00100000:2.0:1788744261.045980:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.045996:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.046019:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418432 00000100:00100000:2.0:1788744261.046022:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418432 00000100:00100000:2.0:1788744261.046043:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788744261.046049:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154418432:12345-0@lo:501: 00000100:00100000:2.0:1788744261.046148:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154418432:12345-0@lo:501: Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.046157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788744261.046184:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418432:0@lo:501: 00000100:00100000:2.0:1788744261.046209:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418560:0@lo:503: 00000100:00100000:2.0:1788744261.046246:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.046259:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.046863:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154417792:0@lo:400: 00000100:00100000:3.0:1788744261.047031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744261.047699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744261.047715:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418560 00000100:00100000:0.0:1788744261.047722:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418560 00000100:00100000:0.0:1788744261.047775:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788744261.047785:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154418560:12345-0@lo:503: 00000100:00100000:0.0:1788744261.047913:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154418560:12345-0@lo:503: Request processed in 128us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.047920:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788744261.047979:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418560:0@lo:503: 00000100:00080000:0.0:1788744261.048082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:2.0:1788744261.048982:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00080000:1.0:1788744261.050261:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a7800 x1875634154417408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.050276:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154417408:0@lo:400: 00010000:00080000:1.0:1788744261.050288:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a5180 x1875634154417920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.050308:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154417920:0@lo:400: 00010000:00080000:1.0:1788744261.050333:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a6d80 x1875634154417024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.050340:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154417024:0@lo:400: 00000100:00100000:3.0:1788744261.050703:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154417792 00000100:00100000:3.0:1788744261.050711:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154417792 00000100:00100000:3.0:1788744261.050769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744261.050778:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3646:x1875634154417792:12345-0@lo:400: 00000100:00100000:3.0:1788744261.050864:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3646:x1875634154417792:12345-0@lo:400: Request processed in 87us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.050871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788744261.050912:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a4380 x1875634154417792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744261.050922:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154417792:0@lo:400: 00000004:00080000:1.0:1788744261.051219:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788744261.051350:0:10031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10031:1875634154418688:0@lo:502: 00000100:00100000:3.0:1788744261.051427:0:10031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.051457:0:10031:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.051871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418688 00000100:00100000:1.0:1788744261.051882:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418688 00000100:00100000:1.0:1788744261.051908:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788744261.051914:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10031:x1875634154418688:12345-0@lo:502: 00000100:00100000:1.0:1788744261.052017:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10031:x1875634154418688:12345-0@lo:502: Request processed in 103us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.052026:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788744261.052169:0:10031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10031:1875634154418688:0@lo:502: 00000100:00100000:3.0:1788744261.052212:0:10031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10031:1875634154418816:0@lo:502: 00000100:00100000:3.0:1788744261.052244:0:10031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.053174:0:10031:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.053359:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418816 00000100:00100000:1.0:1788744261.053365:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418816 00000100:00100000:1.0:1788744261.053392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788744261.053398:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10031:x1875634154418816:12345-0@lo:502: 00000100:00100000:1.0:1788744261.053500:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10031:x1875634154418816:12345-0@lo:502: Request processed in 101us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.053507:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788744261.053592:0:10031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10031:1875634154418816:0@lo:502: 00000040:00080000:3.0:1788744261.053617:0:10031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788744261.053765:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788744261.053788:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744261.053797:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.053808:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744261.053825:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744261.053828:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75196e800 from 6 10000000:01000000:1.0:1788744261.053831:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744261.053854:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.053862:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.053880:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744261.053894:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418944:0@lo:101: 00000100:00100000:1.0:1788744261.053923:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.053941:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.053953:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154418944 00000100:00100000:1.0:1788744261.053956:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154418944 00000100:00100000:1.0:1788744261.053985:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788744261.053991:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154418944:12345-0@lo:101: 00010000:00010000:1.0:1788744261.054000:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744261.054010:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c5600/0xb6207a6e76dcc10c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc105 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.054030:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c5600/0xb6207a6e76dcc10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc105 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.054040:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c5600/0xb6207a6e76dcc10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc105 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.054048:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c5600, rc 0) 00000100:00100000:1.0:1788744261.054177:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154418944:12345-0@lo:101: Request processed in 186us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.054184:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788744261.054209:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154418944:0@lo:101: 00010000:00010000:1.0:1788744261.054222:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744261.054240:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744261.054275:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419072:0@lo:256: 00000100:00100000:1.0:1788744261.054300:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.056204:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.061240:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419072 00000100:00100000:3.0:1788744261.061254:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419072 00000100:00100000:3.0:1788744261.061313:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788744261.061323:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154419072:12345-0@lo:256: 20000000:01000000:3.0:1788744261.061347:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744261.061370:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744261.061373:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788744261.061517:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154419072:12345-0@lo:256: Request processed in 195us (7215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.061526:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788744261.061577:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419072:0@lo:256: 10000000:01000000:3.0:1788744261.061630:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744261.061640:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.061651:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744261.061660:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788744261.061663:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788744261.061665:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744261.061694:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.061704:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.061713:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.061730:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419200:0@lo:101: 00000100:00100000:3.0:1788744261.061759:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.061794:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744261.061845:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419200 00000100:00100000:0.0:1788744261.061850:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419200 00000100:00100000:0.0:1788744261.061882:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788744261.061890:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154419200:12345-0@lo:101: 00010000:00010000:0.0:1788744261.061898:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744261.061909:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc113 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744261.061929:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744261.061939:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744261.061953:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031a00, rc 0) 00000100:00100000:0.0:1788744261.061982:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154419200:12345-0@lo:101: Request processed in 93us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.061988:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788744261.062151:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419200:0@lo:101: 00010000:00010000:3.0:1788744261.062173:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.062181:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.062232:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419328:0@lo:501: 00000100:00100000:3.0:1788744261.062257:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.062278:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.062289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419328 00000100:00100000:3.0:1788744261.062293:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419328 00000100:00100000:3.0:1788744261.062309:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788744261.062314:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154419328:12345-0@lo:501: 00000100:00100000:2.0:1788744261.062344:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875634154418176:12345-0@lo:700: Request processed in 21926us (22814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.062360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744261.062434:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154419328:12345-0@lo:501: Request processed in 118us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.062441:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788744261.062469:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419328:0@lo:501: 00000100:00100000:3.0:1788744261.062492:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419456:0@lo:503: 00000100:00100000:3.0:1788744261.062525:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.062543:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.062553:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419456 00000100:00100000:3.0:1788744261.062557:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419456 00000100:00100000:3.0:1788744261.062575:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788744261.062581:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154419456:12345-0@lo:503: 00000100:00100000:3.0:1788744261.062656:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154419456:12345-0@lo:503: Request processed in 74us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.062663:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788744261.062704:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419456:0@lo:503: 00000100:00100000:3.0:1788744261.063895:0:10033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10033:1875634154419584:0@lo:502: 00010000:00080000:2.0:1788744261.063898:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431ed500 x1875634154418176/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744261.063911:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875634154418176:0@lo:700: 40000000:02000000:2.0:1788744261.063920:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788744261.063946:0:10033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.063969:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419584 00000100:00100000:3.0:1788744261.063974:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419584 00000100:00100000:3.0:1788744261.064001:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788744261.064008:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10033:x1875634154419584:12345-0@lo:502: 00000100:00100000:3.0:1788744261.064109:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10033:x1875634154419584:12345-0@lo:502: Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.064117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788744261.064158:0:10033:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.064170:0:10033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10033:1875634154419584:0@lo:502: 00000020:01000000:3.0:1788744261.064193:0:10033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744261.064200:0:10033:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788744261.064206:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744261.064209:0:10033:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788744261.064213:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788744261.064217:0:10033:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1788744261.064236:0:10033:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788744261.064239:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744261.064252:0:10033:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ac64323cd40) 00000020:00000080:3.0:1788744261.064275:0:10033:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788744261.064280:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788744261.064362:0:10033:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788744261.064368:0:10033:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788744261.064374:0:10033:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcc128 00010000:00080000:3.0:1788744261.064415:0:10033:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac775a45800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744261.064622:0:10033:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788744261.064745:0:10033:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788744261.064755:0:10033:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788744261.064949:0:10033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744261.065069:0:10033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744261.065192:0:10033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788744261.065270:0:10033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788744261.070796:0:10034:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744261.070804:0:10034:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788744261.078172:0:10033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744261.078189:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744261.078268:0:10033:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788744261.078293:0:10033:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcc12f 00000100:00080000:3.0:1788744261.078303:0:10033:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744261.078314:0:10033:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac775a45800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744261.078377:0:10033:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435a4380 x1875634154419712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00100000:2.0:1788744261.078470:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788744261.087530:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154419712:0@lo:8: 00000100:00100000:2.0:1788744261.087530:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10030:x1875634154418048:12345-0@lo:700: Request processed in 48053us (48161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.087602:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.087605:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744261.087685:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419712 00000100:00100000:0.0:1788744261.087693:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419712 00000100:00100000:0.0:1788744261.087726:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744261.087732:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875634154419712:12345-0@lo:8: 00010000:00080000:0.0:1788744261.087761:0:8430:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788744261.087791:0:8430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcc136 00002000:00100000:0.0:1788744261.087822:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ac6433c8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788744261.087826:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788744261.087828:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1788744261.087896:0:10030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337d880 x1875634154418048/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788744261.087906:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788744261.087908:0:10030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154418048:0@lo:700: 00000100:00080000:0.0:1788744261.087926:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744261.087970:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875634154419712:12345-0@lo:8: Request processed in 238us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.087976:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788744261.088047:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a4380 x1875634154419712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744261.088056:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744261.088063:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788744261.088070:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788744261.088075:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788744261.088077:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775a45800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788744261.088091:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788744261.088096:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154419712:0@lo:8: 00000004:00080000:0.0:1788744261.088135:0:10034:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788744261.088187:0:10034:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 242769784449ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788744261.088193:0:10034:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1788744261.088442:0:10033:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788744261.088509:0:10033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744261.088515:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744261.088522:0:10033:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788744261.088527:0:10033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744261.088531:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744261.088532:0:10033:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744261.088535:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744261.088549:0:10033:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788744261.088577:0:10033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10033:1875634154419840:0@lo:502: 00000100:00100000:0.0:1788744261.089143:0:10033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744261.089174:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419840 00000100:00100000:0.0:1788744261.089180:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419840 00000100:00100000:0.0:1788744261.089216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788744261.089224:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10033:x1875634154419840:12345-0@lo:502: 00000100:00100000:0.0:1788744261.089323:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10033:x1875634154419840:12345-0@lo:502: Request processed in 99us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.089330:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788744261.089427:0:10033:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642562300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744261.089442:0:10033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10033:1875634154419840:0@lo:502: 00000020:01000000:0.0:1788744261.089464:0:10033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744261.089470:0:10033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744261.089471:0:10033:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788744261.089478:0:10033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1788744261.091979:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788744261.092014:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788744261.092025:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092043:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744261.092054:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788744261.092056:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac750753380 from 1 10000000:01000000:3.0:1788744261.092059:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744261.092095:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092103:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092113:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.092134:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419968:0@lo:101: 00000100:00100000:3.0:1788744261.092195:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.092230:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762b063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.092248:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154419968 00000100:00100000:3.0:1788744261.092254:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154419968 00000100:00100000:3.0:1788744261.092292:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788744261.092299:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154419968:12345-0@lo:101: 00010000:00010000:3.0:1788744261.092311:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744261.092322:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc13d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092341:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092362:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092370:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061aa00, rc 0) 00000100:00100000:3.0:1788744261.092421:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154419968:12345-0@lo:101: Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.092427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788744261.092464:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154419968:0@lo:101: 00010000:00010000:3.0:1788744261.092476:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092484:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744261.092542:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154420096:0@lo:501: 00000100:00100000:3.0:1788744261.092565:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.092578:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762b063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.092589:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420096 00000100:00100000:3.0:1788744261.092592:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420096 00000100:00100000:3.0:1788744261.092614:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788744261.092621:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154420096:12345-0@lo:501: 00000100:00100000:3.0:1788744261.092687:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154420096:12345-0@lo:501: Request processed in 67us (120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744261.092694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788744261.092721:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154420096:0@lo:501: 10000000:01000000:3.0:1788744261.092740:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744261.092750:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744261.092756:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744261.094890:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788744261.100186:0:10030:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788744261.100220:0:10030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154420352:0@lo:7: 00000100:00100000:3.0:1788744261.100267:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154420224:0@lo:13: 00000100:00100000:2.0:1788744261.100286:0:10030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.100298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.100322:0:10030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744261.100341:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420352 00000100:00100000:2.0:1788744261.100348:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420352 00000100:00100000:2.0:1788744261.100393:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744261.100419:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10030:x1875634154420352:12345-0@lo:7: 00002000:00080000:2.0:1788744261.103659:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788744261.103668:0:8431:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788744261.103761:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10030:x1875634154420352:12345-0@lo:7: Request processed in 3357us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.103771:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744261.103811:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420224 00010000:00080000:1.0:1788744261.103843:0:10030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f2680 x1875634154420352/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.103858:0:10030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154420352:0@lo:7: 00000004:00080000:1.0:1788744261.103870:0:10030:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788744261.103906:0:10030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ece00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154420480:0@lo:5: 00000100:00100000:1.0:1788744261.103945:0:10030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.103978:0:10030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6435519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.104046:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420480 00000100:00100000:3.0:1788744261.104053:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420480 00000100:00100000:3.0:1788744261.104102:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744261.104112:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10030:x1875634154420480:12345-0@lo:5: 00002000:00080000:3.0:1788744261.104136:0:8430:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788744261.104172:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10030:x1875634154420480:12345-0@lo:5: Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744261.104177:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788744261.104249:0:10030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431ece00 x1875634154420480/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.104258:0:10030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ece00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154420480:0@lo:5: 00000004:00080000:1.0:1788744261.104268:0:10030:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000004:00080000:1.0:1788744261.105489:0:10035:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788744261.105508:0:10035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154420736:0@lo:7: 00000100:00100000:1.0:1788744261.105551:0:10035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.105582:0:10035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6435519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.105773:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154420608:0@lo:13: 00000100:00100000:3.0:1788744261.105800:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744261.105884:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420608 00000100:00100000:1.0:1788744261.105891:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420608 00000100:00100000:1.0:1788744261.105936:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744261.105943:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154420608:12345-0@lo:13: 00002000:00000024:1.0:1788744261.105967:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788744261.106005:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154420608:12345-0@lo:13: Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.106012:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788744261.106066:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788744261.106090:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431ece00 x1875634154420608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744261.106107:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154420608:0@lo:13: 00000100:00100000:0.0:1788744261.108465:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420736 00000100:00100000:0.0:1788744261.108476:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420736 00000100:00100000:0.0:1788744261.108533:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744261.108555:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10035:x1875634154420736:12345-0@lo:7: 00000100:00100000:2.0:1788744261.111188:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420224 00000100:00100000:2.0:1788744261.111251:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744261.111260:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154420224:12345-0@lo:13: 00002000:00000024:2.0:1788744261.111288:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788744261.111365:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154420224:12345-0@lo:13: Request processed in 106us (11065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744261.111372:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788744261.111442:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0a80 x1875634154420224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744261.111462:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154420224:0@lo:13: 00002000:00080000:1.0:1788744261.112012:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788744261.112018:0:8431:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788744261.112069:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10035:x1875634154420736:12345-0@lo:7: Request processed in 3515us (6516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744261.112076:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788744261.112222:0:10035:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431eed80 x1875634154420736/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744261.112233:0:10035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154420736:0@lo:7: 00000004:00080000:2.0:1788744261.112244:0:10035:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788744261.112276:0:10035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154420864:0@lo:5: 00000100:00100000:2.0:1788744261.112309:0:10035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.112333:0:10035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744261.112742:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420864 00000100:00100000:1.0:1788744261.112748:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420864 00000100:00100000:1.0:1788744261.112896:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744261.112905:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10035:x1875634154420864:12345-0@lo:5: 00002000:00080000:1.0:1788744261.112928:0:8966:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788744261.112931:0:8966:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788744261.121712:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788744261.121732:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788744261.122709:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10035:x1875634154420864:12345-0@lo:5: Request processed in 9800us (10394us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788744261.122720:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788744261.122864:0:10035:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0a80 x1875634154420864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744261.122876:0:10035:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788744261.122882:0:10035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154420864:0@lo:5: 00000004:00080000:2.0:1788744261.122897:0:10035:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788744261.122940:0:10035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154420992:0@lo:700: 00000100:00100000:2.0:1788744261.122970:0:10035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744261.122996:0:10035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.123197:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154420992 00000100:00100000:3.0:1788744261.123204:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154420992 00000100:00100000:3.0:1788744261.123248:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744261.123256:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10035:x1875634154420992:12345-0@lo:700: 00000100:00100000:0.0:1788744261.132703:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10035:x1875634154420992:12345-0@lo:700: Request processed in 9439us (9723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744261.132726:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788744261.132866:0:10035:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0a80 x1875634154420992/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744261.132894:0:10035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154420992:0@lo:700: 00000004:02000040:2.0:1788744261.135165:0:10035:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788744261.150771:0:10035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154421120:0@lo:5: 00000100:00100000:2.0:1788744261.150850:0:10035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744261.150899:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421120 00000100:00100000:2.0:1788744261.150899:0:10035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556c89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744261.150916:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421120 00000100:00100000:3.0:1788744261.150974:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744261.150983:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10035:x1875634154421120:12345-0@lo:5: 00002000:00080000:2.0:1788744261.163356:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788744261.163376:0:8430:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788744261.169062:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10035:x1875634154421120:12345-0@lo:5: Request processed in 18072us (18205us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788744261.169075:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788744261.169262:0:10035:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0a80 x1875634154421120/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744277 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744261.169278:0:10035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10035:1875634154421120:0@lo:5: 00000004:00080000:1.0:1788744261.169292:0:10035:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1788744261.998487:0:10082:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744261.998500:0:10082:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788744261.998601:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744261.998905:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744261.998961:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154421248:0@lo:13: 00000100:00100000:0.0:1788744261.999023:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744262.003823:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421248 00000100:00100000:2.0:1788744262.003836:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421248 00000100:00100000:3.0:1788744262.005065:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744262.005075:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154421248:12345-0@lo:13: 00002000:00000024:3.0:1788744262.005105:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744262.005177:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154421248:12345-0@lo:13: Request processed in 103us (6154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744262.005184:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788744262.005298:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1880 x1875634154421248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744262.005328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154421248:0@lo:13: 00000100:00100000:1.0:1788744262.510705:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154421376:0@lo:13: 00000100:00100000:1.0:1788744262.510777:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744262.510952:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421376 00000100:00100000:0.0:1788744262.510961:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421376 00000100:00100000:0.0:1788744262.511013:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744262.511021:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154421376:12345-0@lo:13: 00002000:00000024:0.0:1788744262.511045:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744262.511099:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154421376:12345-0@lo:13: Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744262.511106:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788744262.511221:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0e00 x1875634154421376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744262.511239:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154421376:0@lo:13: 00000100:00100000:3.0:1788744262.519077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744262.519433:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138644608 00000100:00100000:0.0:1788744262.519443:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138644608 00000100:00100000:0.0:1788744262.519486:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:0.0:1788744262.519494:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1875634138644608:12345-192.168.203.4@tcp:250: 00010000:00080000:0.0:1788744262.519519:0:6511:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 0f3ec557-dc0b-4724-8510-d5e7f831a82c@192.168.203.4@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1788744262.519549:0:6511:0:(genops.c:1384:class_connect()) connect: client 0f3ec557-dc0b-4724-8510-d5e7f831a82c, cookie 0xb6207a6e76dcc14b 00000100:00080000:0.0:1788744262.519662:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744262.519726:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+5:2393:x1875634138644608:12345-192.168.203.4@tcp:250: Request processed in 231us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744262.519732:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:0.0:1788744262.532313:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744262.532635:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138644736 00000100:00100000:3.0:1788744262.532653:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138644736 00000100:00100000:3.0:1788744262.532894:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:3.0:1788744262.532908:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+5:6151:x1875634138644736:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788744262.532929:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744262.532951:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d2c1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.532999:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.533012:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.533027:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061a800, rc 0) 00000100:00100000:3.0:1788744262.533112:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+6:6151:x1875634138644736:12345-192.168.203.4@tcp:101: Request processed in 207us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744262.533136:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:3.0:1788744262.547885:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744262.549930:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138644864 00000100:00100000:0.0:1788744262.549949:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138644864 00000100:00100000:1.0:1788744262.552758:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:1.0:1788744262.552779:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+6:6151:x1875634138644864:12345-192.168.203.4@tcp:501: 00000100:00100000:1.0:1788744262.552987:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+6:6151:x1875634138644864:12345-192.168.203.4@tcp:501: Request processed in 212us (5115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744262.552996:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:2.0:1788744262.557186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744262.557271:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138644992 00000100:00100000:3.0:1788744262.557281:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138644992 00000100:00100000:3.0:1788744262.557344:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:3.0:1788744262.557356:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+6:6151:x1875634138644992:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788744262.557373:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744262.557390:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d2c8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.557462:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.557475:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.557484:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061b400, rc 0) 00000100:00100000:3.0:1788744262.557540:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+7:6151:x1875634138644992:12345-192.168.203.4@tcp:101: Request processed in 187us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744262.557548:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:3.0:1788744262.561788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744262.563205:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645120 00000100:00100000:0.0:1788744262.563221:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645120 00000100:00100000:0.0:1788744262.563295:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:0.0:1788744262.563305:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+7:6151:x1875634138645120:12345-192.168.203.4@tcp:501: 00000100:00100000:0.0:1788744262.564822:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6151:x1875634138645120:12345-192.168.203.4@tcp:501: Request processed in 1502us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744262.564835:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:0.0:1788744262.576587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744262.582490:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645248 00000100:00100000:1.0:1788744262.582503:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645248 00000100:00100000:1.0:1788744262.582558:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:1.0:1788744262.582566:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6151:x1875634138645248:12345-192.168.203.4@tcp:503: 00000100:00100000:1.0:1788744262.582714:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6151:x1875634138645248:12345-192.168.203.4@tcp:503: Request processed in 147us (6136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744262.582722:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:2.0:1788744262.586497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744262.586588:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645376 00000100:00100000:3.0:1788744262.586598:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645376 00000100:00100000:3.0:1788744262.586655:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:3.0:1788744262.586666:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6170:x1875634138645376:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788744262.586830:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6170:x1875634138645376:12345-192.168.203.4@tcp:502: Request processed in 165us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744262.586848:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:3.0:1788744262.626332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744262.632086:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645504 00000100:00100000:0.0:1788744262.632102:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645504 00000100:00100000:0.0:1788744262.632179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:0.0:1788744262.632190:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6170:x1875634138645504:12345-192.168.203.4@tcp:502: 00000100:00100000:0.0:1788744262.632363:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6170:x1875634138645504:12345-192.168.203.4@tcp:502: Request processed in 174us (6039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744262.632371:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:0.0:1788744262.636169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744262.636341:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645632 00000100:00100000:1.0:1788744262.636352:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645632 00000100:00100000:1.0:1788744262.636439:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:1.0:1788744262.636450:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6151:x1875634138645632:12345-192.168.203.4@tcp:101: 00010000:00010000:1.0:1788744262.636466:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744262.636496:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c4000/0xb6207a6e76dcc160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d2f9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744262.636525:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c4000/0xb6207a6e76dcc160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2f9 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744262.636535:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c4000/0xb6207a6e76dcc160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2f9 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744262.636544:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c4000, rc 0) 00000100:00100000:1.0:1788744262.636595:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6151:x1875634138645632:12345-192.168.203.4@tcp:101: Request processed in 147us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744262.636602:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:3.0:1788744262.644047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744262.644121:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645760 00000100:00100000:0.0:1788744262.644130:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645760 00000100:00100000:0.0:1788744262.644235:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:0.0:1788744262.644251:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6151:x1875634138645760:12345-192.168.203.4@tcp:256: 20000000:01000000:0.0:1788744262.644284:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788744262.644465:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788744262.644470:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788744262.644473:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788744262.644476:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788744262.644479:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788744262.652003:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6151:x1875634138645760:12345-192.168.203.4@tcp:256: Request processed in 7748us (7955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744262.652027:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:0.0:1788744262.674146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744262.674214:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138645888 00000100:00100000:3.0:1788744262.674226:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138645888 00000100:00100000:3.0:1788744262.674285:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:3.0:1788744262.674296:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6151:x1875634138645888:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788744262.674316:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744262.674332:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.674376:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.674388:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744262.674440:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061b600, rc 0) 00000100:00100000:2.0:1788744262.674918:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6151:x1875634138645888:12345-192.168.203.4@tcp:101: Request processed in 621us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744262.674927:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:3.0:1788744262.676705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744262.676779:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646016 00000100:00100000:0.0:1788744262.676789:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646016 00000100:00100000:0.0:1788744262.676854:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:0.0:1788744262.676864:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6151:x1875634138646016:12345-192.168.203.4@tcp:501: 00000100:00100000:0.0:1788744262.677006:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6151:x1875634138646016:12345-192.168.203.4@tcp:501: Request processed in 143us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744262.677015:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:3.0:1788744262.679701:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744262.681781:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646144 00000100:00100000:2.0:1788744262.681796:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646144 00000100:00100000:2.0:1788744262.682056:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:2.0:1788744262.682069:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6151:x1875634138646144:12345-192.168.203.4@tcp:503: 00000100:00100000:2.0:1788744262.682301:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6151:x1875634138646144:12345-192.168.203.4@tcp:503: Request processed in 234us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744262.682310:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:2.0:1788744262.691246:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744262.692086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646272 00000100:00100000:1.0:1788744262.692099:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646272 00000100:00100000:1.0:1788744262.692220:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:1.0:1788744262.692232:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6176:x1875634138646272:12345-192.168.203.4@tcp:502: 00000100:00100000:1.0:1788744262.692427:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6176:x1875634138646272:12345-192.168.203.4@tcp:502: Request processed in 196us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744262.692435:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:3.0:1788744262.696069:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744262.696223:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646400 00000100:00100000:2.0:1788744262.696245:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646400 00000100:00100000:2.0:1788744262.696299:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:2.0:1788744262.696310:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6176:x1875634138646400:12345-192.168.203.4@tcp:502: 00000100:00100000:2.0:1788744262.696486:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6176:x1875634138646400:12345-192.168.203.4@tcp:502: Request processed in 177us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744262.696495:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:2.0:1788744262.699946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744262.699981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744262.700072:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646528 00000100:00100000:3.0:1788744262.700082:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646528 00000100:00100000:3.0:1788744262.700133:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646784 00000100:00100000:3.0:1788744262.700136:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646784 00000100:00100000:3.0:1788744262.700157:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788744262.700165:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1875634138646528:12345-192.168.203.4@tcp:38: 00000100:00100000:1.0:1788744262.700189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00080000:3.0:1788744262.700192:0:7792:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 244 last 0 00000100:00100000:1.0:1788744262.700199:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875634138646784:12345-192.168.203.4@tcp:38: 00010000:00080000:1.0:1788744262.700220:0:6515:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1788744262.700260:0:7792:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc16e 00000020:00000080:1.0:1788744262.700264:0:6515:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc175 00000004:00100000:3.0:1788744262.700285:0:7792:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:1.0:1788744262.700295:0:6515:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788744262.700629:0:7792:0:(import.c:65:import_set_state_nolock()) ffff9ac6436b5800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788744262.700644:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9ac77f755000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744262.702241:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138646528:12345-192.168.203.4@tcp:38: Request processed in 2070us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744262.702251:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788744262.704812:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138646784:12345-192.168.203.4@tcp:38: Request processed in 4586us (4802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744262.704840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00010000:0.0:1788744263.022538:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744263.535216:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744263.535241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154421504:0@lo:41: 00000100:00100000:1.0:1788744263.535318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744263.535440:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421504 00000100:00100000:0.0:1788744263.535448:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421504 00000100:00100000:0.0:1788744263.535503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744263.535512:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154421504:12345-0@lo:41: 00000004:00000024:0.0:1788744263.535544:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744263.535603:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154421504:12345-0@lo:41: Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744263.535610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788744263.535809:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154421504:0@lo:41: 00000100:00100000:2.0:1788744263.716380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744263.716630:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646656 00000100:00100000:0.0:1788744263.716640:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646656 00000100:00100000:0.0:1788744263.716716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788744263.716728:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138646656:12345-192.168.203.4@tcp:41: 00000004:00000024:0.0:1788744263.716763:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788744263.716848:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138646656:12345-192.168.203.4@tcp:41: Request processed in 123us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744263.716854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:3.0:1788744263.717125:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744263.718900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744263.718981:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138646912 00000100:00100000:3.0:1788744263.718989:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138646912 00000100:00080000:0.0:1788744263.719102:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744263.719302:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788744263.719313:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138646912:12345-192.168.203.4@tcp:41: 00000004:00000024:3.0:1788744263.719339:0:7792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744263.719435:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138646912:12345-192.168.203.4@tcp:41: Request processed in 92us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744263.719443:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788744263.731721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744263.731841:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647040 00000100:00100000:2.0:1788744263.731852:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647040 00000100:00100000:2.0:1788744263.731912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788744263.731923:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647040:12345-192.168.203.4@tcp:41: 00000004:00000024:2.0:1788744263.731953:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788744263.732074:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647040:12345-192.168.203.4@tcp:41: Request processed in 153us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744263.732082:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788744263.736139:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744263.736234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647168 00000100:00100000:1.0:1788744263.736245:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647168 00000100:00100000:1.0:1788744263.736301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788744263.736312:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647168:12345-192.168.203.4@tcp:40: 00000100:00100000:1.0:1788744263.736430:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647168:12345-192.168.203.4@tcp:40: Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744263.736438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788744263.740723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744263.740772:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744263.740821:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744263.740857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744263.740940:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647296 00000100:00100000:0.0:1788744263.740951:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647296 00000100:00100000:0.0:1788744263.740991:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647424 00000100:00100000:0.0:1788744263.740995:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647424 00000100:00100000:0.0:1788744263.741012:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788744263.741021:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875634138647296:12345-192.168.203.4@tcp:8: 00010000:00080000:0.0:1788744263.741052:0:8432:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788744263.741084:0:8432:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc17c 00002000:00100000:0.0:1788744263.741095:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e50f0a12-1dec-4e87-aa9a-b50e34f62300/ffff9ac6433ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744263.741113:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788744263.741293:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788744263.741324:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744263.741387:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138647296:12345-192.168.203.4@tcp:8: Request processed in 366us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744263.741394:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788744263.741445:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788744263.741451:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875634138647424:12345-192.168.203.4@tcp:8: 00010000:00080000:0.0:1788744263.741467:0:8432:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788744263.741484:0:8432:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc183 00002000:00100000:0.0:1788744263.741489:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e50f0a12-1dec-4e87-aa9a-b50e34f62300/ffff9ac6433cc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744263.741500:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788744263.741606:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788744263.741623:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744263.741662:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138647424:12345-192.168.203.4@tcp:8: Request processed in 209us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744263.741669:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1788744263.742191:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647552 00000100:00100000:1.0:1788744263.742200:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647552 00000100:00100000:1.0:1788744263.742249:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788744263.742258:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647552:12345-192.168.203.4@tcp:900: 00000100:00100000:1.0:1788744263.742318:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647552:12345-192.168.203.4@tcp:900: Request processed in 61us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744263.742325:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788744263.742439:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647680 00000100:00100000:2.0:1788744263.742444:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647680 00000100:00100000:2.0:1788744263.742473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:2.0:1788744263.742480:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138647680:12345-192.168.203.4@tcp:400: 00000100:00100000:2.0:1788744263.742508:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138647680:12345-192.168.203.4@tcp:400: Request processed in 28us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744263.742515:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:3.0:1788744263.747021:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744263.747170:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647808 00000100:00100000:1.0:1788744263.747181:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647808 00000100:00100000:1.0:1788744263.747242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744263.747253:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647808:12345-192.168.203.4@tcp:33: 00000004:00080000:1.0:1788744263.784888:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37544us 00000004:00200000:2.0:1788744263.808503:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788744263.808627:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6151:x1875634138647808:12345-192.168.203.4@tcp:33: Request processed in 61370us (61610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744263.808644:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788744263.967849:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744263.968026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138647936 00000100:00100000:2.0:1788744263.968041:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138647936 00000100:00100000:2.0:1788744263.968112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788744263.968124:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6194:x1875634138647936:12345-192.168.203.4@tcp:101: 00010000:00010000:2.0:1788744263.968143:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744263.968197:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83c00/0xb6207a6e76dcc18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d331 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744263.968261:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744263.968275:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744263.968290:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744263.968338:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788744263.968342:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744263.968357:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744263.968392:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83c00/0xb6207a6e76dcc18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d331 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744263.968453:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d331 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744263.968481:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac762c95400) 00010000:00010000:2.0:1788744263.968484:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744263.968488:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82600, rc 0) 00000100:00100000:2.0:1788744263.968555:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:6194:x1875634138647936:12345-192.168.203.4@tcp:101: Request processed in 433us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744263.968561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00010000:00010000:2.0:1788744264.046773:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744264.559486:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154421632:0@lo:41: 00000100:00100000:1.0:1788744264.559595:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744264.559663:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421632 00000100:00100000:0.0:1788744264.559674:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421632 00000100:00100000:0.0:1788744264.559747:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744264.559758:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154421632:12345-0@lo:41: 00000004:00000024:0.0:1788744264.559811:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788744264.559873:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154421632:12345-0@lo:41: Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744264.559879:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744264.560151:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154421632:0@lo:41: 00010000:00010000:0.0:1788744265.070795:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744266.094718:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154422016:0@lo:400: 00000100:00100000:2.0:1788744266.094779:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154422144:0@lo:400: 00000100:00100000:2.0:1788744266.094875:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.094958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154422656:0@lo:400: 00000100:00100000:2.0:1788744266.094995:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.095031:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154423168:0@lo:400: 00000100:00100000:3.0:1788744266.095056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.095070:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744266.095198:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744266.095265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154421888:0@lo:400: 00000100:00100000:3.0:1788744266.095297:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154422528:0@lo:400: 00000100:00100000:1.0:1788744266.095313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744266.095352:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154422400:0@lo:400: 00000100:00100000:3.0:1788744266.095364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744266.095430:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154423040:0@lo:400: 00000100:00100000:2.0:1788744266.095566:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788744266.095578:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154421760:0@lo:400: 00000100:00100000:2.0:1788744266.095631:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744266.095672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744266.095706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154422912:0@lo:400: 00000100:00100000:1.0:1788744266.095729:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.097451:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154422272:0@lo:400: 00000100:00100000:2.0:1788744266.097515:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.097545:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154422784:0@lo:400: 00000100:00100000:2.0:1788744266.097572:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.097725:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154423296:0@lo:400: 00000100:00100000:2.0:1788744266.097753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744266.097838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422144 00000100:00100000:2.0:1788744266.097848:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422144 00000100:00100000:2.0:1788744266.097899:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421888 00000100:00100000:2.0:1788744266.097903:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421888 00000100:00100000:2.0:1788744266.097918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422528 00000100:00100000:2.0:1788744266.097921:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422528 00000100:00100000:2.0:1788744266.097952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422400 00000100:00100000:2.0:1788744266.097955:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422400 00000100:00100000:2.0:1788744266.097969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422912 00000100:00100000:2.0:1788744266.097973:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422912 00000100:00100000:2.0:1788744266.097993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744266.098004:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154422144:12345-0@lo:400: 00000100:00100000:2.0:1788744266.098073:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154422144:12345-0@lo:400: Request processed in 70us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744266.098081:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744266.099167:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422656 00000100:00100000:0.0:1788744266.099184:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422656 00000100:00100000:0.0:1788744266.099232:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423168 00000100:00100000:0.0:1788744266.099235:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423168 00000100:00100000:0.0:1788744266.099250:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422784 00000100:00100000:0.0:1788744266.099253:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422784 00000100:00100000:0.0:1788744266.099270:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423296 00000100:00100000:0.0:1788744266.099273:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423296 00000100:00100000:0.0:1788744266.099294:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744266.099304:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154422656:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099423:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154422656:12345-0@lo:400: Request processed in 121us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099431:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744266.099447:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744266.099453:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154423168:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099482:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154423168:12345-0@lo:400: Request processed in 30us (4414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099501:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744266.099513:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744266.099518:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154422784:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099546:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154422784:12345-0@lo:400: Request processed in 28us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099551:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744266.099560:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744266.099565:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154423296:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099590:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154423296:12345-0@lo:400: Request processed in 25us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099596:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744266.099616:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154421760 00000100:00100000:0.0:1788744266.099620:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154421760 00000100:00100000:0.0:1788744266.099649:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788744266.099655:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154421760:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099685:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154421760:12345-0@lo:400: Request processed in 30us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099691:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788744266.099721:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422016 00000100:00100000:0.0:1788744266.099725:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422016 00000100:00100000:0.0:1788744266.099750:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154422272 00000100:00100000:0.0:1788744266.099753:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154422272 00000100:00100000:0.0:1788744266.099764:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744266.099769:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154422016:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099808:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154422016:12345-0@lo:400: Request processed in 39us (4759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099822:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744266.099833:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744266.099838:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154422272:12345-0@lo:400: 00000100:00100000:0.0:1788744266.099863:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154422272:12345-0@lo:400: Request processed in 25us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.099868:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744266.100373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744266.100429:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154421888:12345-0@lo:400: 00000100:00100000:2.0:1788744266.100518:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154421888:12345-0@lo:400: Request processed in 119us (5204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744266.100527:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744266.100562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744266.100573:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744266.100575:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154422528:12345-0@lo:400: 00000100:00100000:0.0:1788744266.100590:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154422400:12345-0@lo:400: 00000100:00100000:0.0:1788744266.100638:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154422400:12345-0@lo:400: Request processed in 55us (4966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.100644:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744266.100660:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744266.100666:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154422912:12345-0@lo:400: 00000100:00100000:0.0:1788744266.100693:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154422912:12345-0@lo:400: Request processed in 27us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.100699:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744266.100738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744266.100807:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154421888:0@lo:400: 00000100:00100000:0.0:1788744266.100829:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154422400:0@lo:400: 00000100:00100000:1.0:1788744266.100832:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154422016:0@lo:400: 00000100:00100000:0.0:1788744266.100847:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154422912:0@lo:400: 00000100:00100000:1.0:1788744266.100892:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423040 00000100:00100000:1.0:1788744266.100901:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423040 00000100:00080000:0.0:1788744266.100931:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744266.100940:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744266.100942:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744266.100945:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744266.100958:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788744266.100970:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154423040:12345-0@lo:400: 00000100:00100000:0.0:1788744266.100976:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154421760:0@lo:400: 00000100:00100000:0.0:1788744266.101012:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154422272:0@lo:400: 00010000:00080000:0.0:1788744266.101032:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc9f80 x1875634154422784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744266.101041:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154423040:12345-0@lo:400: Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744266.101051:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788744266.101234:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154422784:0@lo:400: 00010000:00080000:0.0:1788744266.101253:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8e00 x1875634154423296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744266.101262:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154423296:0@lo:400: 00000100:00100000:0.0:1788744266.101274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154422144:0@lo:400: 00010000:00080000:0.0:1788744266.101284:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc9c00 x1875634154422656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744266.101292:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154422656:0@lo:400: 00010000:00080000:0.0:1788744266.101303:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc9880 x1875634154423168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744266.101310:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154423168:0@lo:400: 00000100:00100000:2.0:1788744266.102824:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154422528:12345-0@lo:400: Request processed in 2244us (7460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744266.102837:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788744266.103688:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8000 x1875634154423040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744266.103711:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154423040:0@lo:400: 00010000:00080000:1.0:1788744266.103763:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdca680 x1875634154422528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744266.103773:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154422528:0@lo:400: 00000100:00100000:2.0:1788744266.164675:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744266.165553:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648064 00000100:00100000:0.0:1788744266.165569:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648064 00000100:00100000:0.0:1788744266.165670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788744266.165681:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:6246:x1875634138648064:12345-192.168.203.4@tcp:41: 00000004:00000024:0.0:1788744266.165718:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788744266.165806:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:6246:x1875634138648064:12345-192.168.203.4@tcp:41: Request processed in 126us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.165814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00080000:2.0:1788744266.166097:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744266.171979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744266.175413:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648192 00000100:00100000:1.0:1788744266.175429:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648192 00000100:00100000:1.0:1788744266.175586:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788744266.175597:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6246:x1875634138648192:12345-192.168.203.4@tcp:41: 00000004:00000024:1.0:1788744266.175636:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744266.175715:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6246:x1875634138648192:12345-192.168.203.4@tcp:41: Request processed in 120us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744266.175723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00080000:2.0:1788744266.176029:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744266.180491:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744266.182425:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648320 00000100:00100000:0.0:1788744266.182457:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648320 00000100:00100000:0.0:1788744266.182607:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788744266.182619:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6246:x1875634138648320:12345-192.168.203.4@tcp:13: 00002000:00000024:0.0:1788744266.182650:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744266.183473:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6246:x1875634138648320:12345-192.168.203.4@tcp:13: Request processed in 853us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.183482:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00080000:2.0:1788744266.183604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744266.190109:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744266.191052:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648448 00000100:00100000:3.0:1788744266.191064:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648448 00000100:00100000:3.0:1788744266.191140:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788744266.191150:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6246:x1875634138648448:12345-192.168.203.4@tcp:13: 00002000:00000024:3.0:1788744266.191183:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744266.191263:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:6246:x1875634138648448:12345-192.168.203.4@tcp:13: Request processed in 114us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744266.191271:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00080000:2.0:1788744266.191321:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744266.606739:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154423424:0@lo:13: 00000100:00100000:0.0:1788744266.606824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744266.606940:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423424 00000100:00100000:0.0:1788744266.606948:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423424 00000100:00100000:1.0:1788744266.606970:0:10030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154423680:0@lo:5: 00000100:00100000:0.0:1788744266.607011:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744266.607012:0:10030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744266.607029:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154423424:12345-0@lo:13: 00002000:00000024:0.0:1788744266.607055:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744266.607123:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154423424:12345-0@lo:13: Request processed in 98us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.607131:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744266.607155:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423680 00000100:00100000:0.0:1788744266.607159:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423680 00000100:00100000:0.0:1788744266.607195:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744266.607201:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10030:x1875634154423680:12345-0@lo:5: 00002000:00080000:0.0:1788744266.607231:0:8432:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788744266.608907:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10030:x1875634154423680:12345-0@lo:5: Request processed in 1700us (1895us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788744266.608917:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788744266.608988:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431ee680 x1875634154423424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744266.609020:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154423424:0@lo:13: 00000100:00100000:0.0:1788744266.609048:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744266.609059:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154423552:0@lo:13: 00000100:00100000:0.0:1788744266.609093:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744266.611823:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423552 00000100:00100000:0.0:1788744266.611840:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423552 00000100:00100000:0.0:1788744266.611914:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744266.611927:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154423552:12345-0@lo:13: 00002000:00000024:0.0:1788744266.611953:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744266.612040:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154423552:12345-0@lo:13: Request processed in 116us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.612049:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744266.613544:0:10030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74510da80 going to sleep for 11 seconds 00010000:00080000:1.0:1788744266.613766:0:10030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431eed80 x1875634154423680/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744266.613796:0:10030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10030:1875634154423680:0@lo:5: 00000004:00080000:1.0:1788744266.613812:0:10030:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788744266.613858:0:10030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10030:1875634154423808:0@lo:900: 00000100:00100000:1.0:1788744266.613909:0:10030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744266.613952:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423808 00000100:00100000:1.0:1788744266.613958:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423808 00000100:00100000:1.0:1788744266.614003:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744266.614012:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10030:x1875634154423808:12345-0@lo:900: 00000100:00100000:1.0:1788744266.614058:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10030:x1875634154423808:12345-0@lo:900: Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744266.614065:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788744266.614102:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431edc00 x1875634154423552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744266.614130:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154423552:0@lo:13: 00000100:00100000:1.0:1788744266.614154:0:10030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74510da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744266.614167:0:10030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10030:1875634154423808:0@lo:900: 00000001:00080000:0.0:1788744266.624113:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788744266.624128:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000001:00080000:0.0:1788744266.624134:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788744267.119021:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744267.125628:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154423936:0@lo:13: 00000100:00100000:1.0:1788744267.125703:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744267.125916:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154423936 00000100:00100000:2.0:1788744267.125924:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154423936 00000100:00100000:2.0:1788744267.125975:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744267.125984:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154423936:12345-0@lo:13: 00002000:00000024:2.0:1788744267.126004:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744267.126047:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154423936:12345-0@lo:13: Request processed in 64us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744267.126053:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788744267.126090:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44700 x1875634154423936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744267.126108:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154423936:0@lo:13: 00000100:00100000:3.0:1788744267.630884:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154424064:0@lo:13: 00000100:00100000:3.0:1788744267.630949:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744267.631143:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424064 00000100:00100000:2.0:1788744267.631151:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424064 00000100:00100000:2.0:1788744267.631375:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744267.631387:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154424064:12345-0@lo:13: 00002000:00000024:2.0:1788744267.631438:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744267.631494:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154424064:12345-0@lo:13: Request processed in 110us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744267.631501:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788744267.631580:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44700 x1875634154424064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744267.631598:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154424064:0@lo:13: 00010000:00010000:0.0:1788744268.142583:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744268.159984:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000001:00100000:2.0:1788744268.179078:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000100:00100000:3.0:1788744268.655179:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744268.656647:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154424192:0@lo:41: 00000100:00100000:3.0:1788744268.656734:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744268.656814:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424192 00000100:00100000:3.0:1788744268.656822:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424192 00000100:00100000:3.0:1788744268.656868:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788744268.656876:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154424192:12345-0@lo:41: 00000004:00000024:3.0:1788744268.657458:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744268.657513:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154424192:12345-0@lo:41: Request processed in 636us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.657521:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788744268.659830:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154424192:0@lo:41: 00000001:02000400:1.0:1788744268.760687:0:10180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788744268.817338:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744268.817377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744268.817533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648704 00000100:00100000:0.0:1788744268.817542:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648704 00000100:00100000:0.0:1788744268.817596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:0.0:1788744268.817605:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138648704:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1788744268.817668:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138648704:12345-192.168.203.4@tcp:400: Request processed in 64us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.817682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00080000:0.0:1788744268.817702:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744268.817969:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744268.817999:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744268.818022:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744268.818654:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648576 00000100:00100000:0.0:1788744268.818669:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648576 00000100:00100000:0.0:1788744268.818707:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:0.0:1788744268.818716:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138648576:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1788744268.818759:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138648576:12345-192.168.203.4@tcp:400: Request processed in 43us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.818779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:3.0:1788744268.820305:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648960 00000100:00100000:3.0:1788744268.820317:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648960 00000100:00100000:3.0:1788744268.820362:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649088 00000100:00100000:3.0:1788744268.820366:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649088 00000100:00100000:3.0:1788744268.820389:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788744268.820526:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138648960:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788744268.820634:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138648960:12345-192.168.203.4@tcp:400: Request processed in 113us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.820642:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788744268.820663:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788744268.820674:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138649088:12345-192.168.203.4@tcp:400: 00000100:00080000:0.0:1788744268.820685:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744268.820690:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744268.820713:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138649088:12345-192.168.203.4@tcp:400: Request processed in 33us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.820721:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788744268.820743:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138648832 00000100:00100000:3.0:1788744268.820748:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138648832 00000100:00080000:0.0:1788744268.820790:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744268.820802:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1788744268.820810:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138648832:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788744268.820855:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138648832:12345-192.168.203.4@tcp:400: Request processed in 44us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.820861:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00010000:00010000:1.0:1788744269.166929:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744269.168531:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000100:00100000:2.0:1788744269.678621:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744269.678649:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154424320:0@lo:41: 00000100:00100000:2.0:1788744269.678715:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744269.678803:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424320 00000100:00100000:0.0:1788744269.678811:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424320 00000100:00100000:0.0:1788744269.678912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744269.678922:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154424320:12345-0@lo:41: 00000004:00000024:0.0:1788744269.678957:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788744269.679011:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154424320:12345-0@lo:41: Request processed in 91us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744269.679018:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788744269.679065:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154424320:0@lo:41: 00010000:00010000:3.0:1788744270.199030:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744271.215681:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154424448:0@lo:400: 00000100:00100000:3.0:1788744271.215762:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.215804:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154424960:0@lo:400: 00000100:00100000:3.0:1788744271.215831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.215850:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154425472:0@lo:400: 00000100:00100000:3.0:1788744271.215873:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.215901:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154425984:0@lo:400: 00000100:00100000:3.0:1788744271.215923:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.215945:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788744271.215951:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154424576:0@lo:400: 00000100:00100000:3.0:1788744271.215973:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.215991:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154425088:0@lo:400: 00000100:00100000:0.0:1788744271.215997:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424576 00000100:00100000:0.0:1788744271.216004:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424576 00000100:00100000:3.0:1788744271.216009:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.216024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154425600:0@lo:400: 00000100:00100000:3.0:1788744271.216041:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744271.216041:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425088 00000100:00100000:0.0:1788744271.216044:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425088 00000100:00100000:3.0:1788744271.216065:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154424832:0@lo:400: 00000100:00100000:0.0:1788744271.216065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425600 00000100:00100000:0.0:1788744271.216068:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425600 00000100:00100000:0.0:1788744271.216083:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744271.216086:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744271.216090:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154424576:12345-0@lo:400: 00000100:00100000:3.0:1788744271.216095:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154425344:0@lo:400: 00000100:00100000:3.0:1788744271.216110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.216126:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154425856:0@lo:400: 00000100:00100000:0.0:1788744271.216145:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154424576:12345-0@lo:400: Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.216152:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744271.216152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744271.216167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424832 00000100:00100000:3.0:1788744271.216169:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788744271.216170:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424832 00000100:00100000:3.0:1788744271.216174:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154424704:0@lo:400: 00000100:00100000:0.0:1788744271.216183:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744271.216187:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154425088:12345-0@lo:400: 00000100:00100000:3.0:1788744271.216194:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.216209:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154425216:0@lo:400: 00000100:00100000:0.0:1788744271.216211:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154425088:12345-0@lo:400: Request processed in 23us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744271.216216:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744271.216227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744271.216227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744271.216232:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154425600:12345-0@lo:400: 00000100:00100000:3.0:1788744271.216236:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154425728:0@lo:400: 00000100:00100000:3.0:1788744271.216371:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744271.216371:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154425600:12345-0@lo:400: Request processed in 138us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744271.216378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744271.216388:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425216 00000100:00100000:0.0:1788744271.216391:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425216 00000100:00100000:3.0:1788744271.216393:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424448 00000100:00100000:3.0:1788744271.216396:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424448 00000100:00100000:0.0:1788744271.216424:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425728 00000100:00100000:0.0:1788744271.216427:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425728 00000100:00100000:3.0:1788744271.216439:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744271.216439:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788744271.216444:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154424448:12345-0@lo:400: 00000100:00100000:0.0:1788744271.216444:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154424832:12345-0@lo:400: 00000100:00100000:3.0:1788744271.216475:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154424448:12345-0@lo:400: Request processed in 30us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744271.216475:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154424832:12345-0@lo:400: Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.216481:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744271.216481:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744271.216492:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744271.216497:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154425216:12345-0@lo:400: 00000100:00100000:0.0:1788744271.216522:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154425216:12345-0@lo:400: Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744271.216533:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744271.216544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744271.216550:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154425728:12345-0@lo:400: 00000100:00100000:0.0:1788744271.216576:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154425728:12345-0@lo:400: Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744271.216581:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788744271.216597:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744271.216600:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744271.216768:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424960 00000100:00100000:3.0:1788744271.216773:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424960 00010000:00010000:2.0:1788744271.216781:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744271.216809:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154424704 00000100:00100000:3.0:1788744271.216813:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154424704 00000100:00100000:3.0:1788744271.216829:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744271.216836:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154424960:12345-0@lo:400: 00000100:00100000:3.0:1788744271.216872:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154424960:12345-0@lo:400: Request processed in 37us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.216878:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744271.216893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744271.216898:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154424704:12345-0@lo:400: 00000100:00100000:3.0:1788744271.216926:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154424704:12345-0@lo:400: Request processed in 28us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.216932:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744271.216953:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425472 00000100:00100000:3.0:1788744271.216957:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425472 00000100:00100000:3.0:1788744271.216981:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425984 00000100:00100000:3.0:1788744271.216985:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425984 00000100:00100000:3.0:1788744271.216995:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425344 00000100:00100000:3.0:1788744271.216998:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425344 00000100:00100000:3.0:1788744271.217009:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154425856 00000100:00100000:3.0:1788744271.217012:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154425856 00000100:00100000:3.0:1788744271.217025:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744271.217031:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154425472:12345-0@lo:400: 00000100:00100000:3.0:1788744271.217060:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154425472:12345-0@lo:400: Request processed in 30us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.217072:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744271.217086:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744271.217091:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154425984:12345-0@lo:400: 00000100:00100000:3.0:1788744271.217119:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154425984:12345-0@lo:400: Request processed in 28us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.217124:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744271.217134:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744271.217139:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154425344:12345-0@lo:400: 00000100:00100000:3.0:1788744271.217163:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154425344:12345-0@lo:400: Request processed in 25us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.217168:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744271.217178:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744271.217183:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154425856:12345-0@lo:400: 00000100:00100000:3.0:1788744271.217209:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154425856:12345-0@lo:400: Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.217214:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788744271.217253:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744271.217257:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744271.217283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154424704:0@lo:400: 00010000:00080000:3.0:1788744271.217296:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4000 x1875634154425216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.217306:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154425216:0@lo:400: 00010000:00080000:3.0:1788744271.217315:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb6d80 x1875634154425728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.217323:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154425728:0@lo:400: 00000100:00100000:3.0:1788744271.217344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154424832:0@lo:400: 00010000:00080000:3.0:1788744271.217352:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5880 x1875634154425344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.217361:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154425344:0@lo:400: 00010000:00080000:3.0:1788744271.217369:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7100 x1875634154425856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.217375:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788744271.217389:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154425856:0@lo:400: 00000100:00100000:3.0:1788744271.217445:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154424576:0@lo:400: 00000100:00100000:3.0:1788744271.217460:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154425088:0@lo:400: 00000100:00100000:3.0:1788744271.217470:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154425600:0@lo:400: 00000100:00100000:3.0:1788744271.217477:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154424448:0@lo:400: 00000100:00100000:3.0:1788744271.217485:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154424960:0@lo:400: 00010000:00080000:3.0:1788744271.217494:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4e00 x1875634154425472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.217501:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154425472:0@lo:400: 00010000:00080000:3.0:1788744271.217511:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7480 x1875634154425984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.218037:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788744271.218052:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154425984:0@lo:400: 00000100:00100000:3.0:1788744271.726635:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154426112:0@lo:13: 00000100:00100000:3.0:1788744271.726709:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744271.726823:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154426112 00000100:00100000:1.0:1788744271.726832:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154426112 00000100:00100000:1.0:1788744271.726884:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744271.726894:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154426112:12345-0@lo:13: 00002000:00000024:1.0:1788744271.726922:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744271.726977:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154426112:12345-0@lo:13: Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744271.726984:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788744271.727057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643728000 x1875634154426112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.727077:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154426112:0@lo:13: 00000100:00100000:3.0:1788744271.729828:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744271.729852:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154426240:0@lo:13: 00000100:00100000:3.0:1788744271.729914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744271.729967:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154426240 00000100:00100000:3.0:1788744271.729975:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154426240 00000100:00100000:3.0:1788744271.730016:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744271.730025:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154426240:12345-0@lo:13: 00002000:00000024:3.0:1788744271.730046:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744271.730086:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154426240:12345-0@lo:13: Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744271.730092:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788744271.730141:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc4000 x1875634154426240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744271.730159:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154426240:0@lo:13: 00000020:00000080:1.0:1788744272.126884:0:10327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcef3c5930 20000000:00000080:1.0:1788744272.126901:0:10327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac6435a2c00 uarg=0000000000000000 20000000:01000000:1.0:1788744272.126951:0:10327:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788744272.127020:0:10327:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788744272.127024:0:10327:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788744272.127029:0:10327:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788744272.127039:0:10327:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788744272.127098:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788744272.127101:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788744272.130631:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788744272.130973:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788744272.131007:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788744272.131023:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788744272.131034:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788744272.131037:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788744272.133652:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788744272.133977:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788744272.134008:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788744272.134025:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788744272.134037:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788744272.134040:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788744272.135562:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788744272.135828:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788744272.135854:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788744272.135891:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788744272.135907:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788744272.135909:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788744272.138800:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788744272.142037:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788744272.142071:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788744272.142087:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788744272.142098:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788744272.142101:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788744272.142762:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788744272.143117:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788744272.143218:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788744272.143236:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:2.0:1788744272.143249:0:10327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788744272.143269:0:10327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143286:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143293:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143299:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143378:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143386:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143394:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143554:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143561:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143567:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143575:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143581:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143588:0:10327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143626:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143648:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 9 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.143662:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426368:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744272.143792:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143801:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 9 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.143809:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426496:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744272.143838:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143846:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.143855:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426624:0@lo:104: 00000100:00100000:2.0:1788744272.143896:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744272.143942:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.143952:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.143961:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426752:0@lo:104: 00000100:00100000:2.0:1788744272.143985:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744272.144034:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.144044:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.144052:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426880:0@lo:104: 00000100:00100000:2.0:1788744272.144083:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744272.144101:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.144109:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.144117:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427008:0@lo:104: 00000100:00100000:2.0:1788744272.144149:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744272.144166:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.144174:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.144182:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427136:0@lo:104: 00010000:00010000:2.0:1788744272.144204:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.144211:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.144219:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427264:0@lo:104: 00010000:00010000:2.0:1788744272.144252:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.144259:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.144267:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427392:0@lo:104: 00010000:00010000:2.0:1788744272.144289:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.144296:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.147947:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427520:0@lo:104: 00010000:00010000:2.0:1788744272.148039:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.148052:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.148060:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427648:0@lo:104: 00000100:00100000:2.0:1788744272.148081:0:10327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744272.148953:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788744272.148988:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.149014:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.149024:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.149033:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.149040:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.149048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154426624 00000100:00100000:1.0:1788744272.149056:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154426624 00000100:00100000:1.0:1788744272.149096:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154426752 00000100:00100000:1.0:1788744272.149099:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154426752 00000100:00100000:1.0:1788744272.149111:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154426880 00000100:00100000:1.0:1788744272.149114:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154426880 00000100:00100000:1.0:1788744272.149124:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427008 00000100:00100000:1.0:1788744272.149126:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427008 00000100:00100000:1.0:1788744272.149133:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427136 00000100:00100000:1.0:1788744272.149135:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427136 00000100:00100000:1.0:1788744272.149142:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427264 00000100:00100000:1.0:1788744272.149145:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427264 00000100:00100000:1.0:1788744272.149153:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427392 00000100:00100000:1.0:1788744272.149155:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427392 00000100:00100000:1.0:1788744272.149162:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427520 00000100:00100000:1.0:1788744272.149164:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427520 00000100:00100000:1.0:1788744272.149173:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427648 00000100:00100000:1.0:1788744272.149188:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427648 00000100:00100000:1.0:1788744272.149205:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744272.149214:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:10327:x1875634154426624:12345-0@lo:104: 00010000:00010000:1.0:1788744272.149228:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.149308:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744272.149314:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+11:10327:x1875634154426624:12345-0@lo:104: Request processed in 102us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.149320:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744272.149338:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744272.149343:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+10:10327:x1875634154426752:12345-0@lo:104: 00010000:00010000:1.0:1788744272.149350:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.149388:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744272.149393:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+10:10327:x1875634154426752:12345-0@lo:104: Request processed in 51us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.149527:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744272.149621:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744272.149630:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:10327:x1875634154426880:12345-0@lo:104: 00010000:00010000:1.0:1788744272.149638:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.149674:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788744272.149679:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+9:10327:x1875634154426880:12345-0@lo:104: Request processed in 52us (5595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.149685:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744272.149721:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744272.149732:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+8:10327:x1875634154427008:12345-0@lo:104: 00010000:00010000:1.0:1788744272.149750:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.149780:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788744272.149784:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+8:10327:x1875634154427008:12345-0@lo:104: Request processed in 59us (5635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.149789:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744272.149818:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744272.149824:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+7:10327:x1875634154427136:12345-0@lo:104: 00010000:00010000:1.0:1788744272.149830:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.149855:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788744272.149860:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+7:10327:x1875634154427136:12345-0@lo:104: Request processed in 37us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.149865:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744272.149876:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744272.149881:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:10327:x1875634154427264:12345-0@lo:104: 00000100:00100000:2.0:1788744272.149998:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426624:0@lo:104: 00000100:00100000:2.0:1788744272.150008:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426752:0@lo:104: 00000100:00100000:2.0:1788744272.150014:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426880:0@lo:104: 00000100:00100000:2.0:1788744272.150019:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427008:0@lo:104: 00000100:00100000:2.0:1788744272.150026:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427136:0@lo:104: 00010000:00010000:1.0:1788744272.150068:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150106:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788744272.150111:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:10327:x1875634154427264:12345-0@lo:104: Request processed in 231us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.150118:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744272.150136:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744272.150143:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:10327:x1875634154427392:12345-0@lo:104: 00010000:00010000:1.0:1788744272.150151:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150176:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788744272.150181:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:10327:x1875634154427392:12345-0@lo:104: Request processed in 39us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.150186:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744272.150198:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788744272.150204:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:10327:x1875634154427520:12345-0@lo:104: 00010000:00010000:1.0:1788744272.150211:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150235:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788744272.150239:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:10327:x1875634154427520:12345-0@lo:104: Request processed in 36us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.150245:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788744272.150255:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744272.150261:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:10327:x1875634154427648:12345-0@lo:104: 00010000:00010000:1.0:1788744272.150267:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150293:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1788744272.150298:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:10327:x1875634154427648:12345-0@lo:104: Request processed in 37us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.150312:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788744272.150352:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788744272.150357:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150364:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061ae00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150368:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150376:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150382:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150387:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150457:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150464:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150482:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150490:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc13d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc144 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150501:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788744272.150504:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150510:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782171800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150513:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150526:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150532:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150538:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150563:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150570:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150584:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150591:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac782171800/0xb6207a6e76dcc113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc11a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150602:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788744272.150605:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150611:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170e00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150614:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150620:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150626:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150638:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150652:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150658:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150664:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150670:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac782170e00/0xb6207a6e76dcc0f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150681:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788744272.150684:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150689:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150692:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150699:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150705:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150710:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150721:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150727:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150750:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150757:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac782170200/0xb6207a6e76dcc0cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150767:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788744272.150770:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150776:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150779:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150785:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150791:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150796:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150809:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150815:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150819:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150825:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac782170c00/0xb6207a6e76dcc0b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150834:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788744272.150842:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150848:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031400 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150852:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150859:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150865:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150870:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150883:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150889:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150893:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150900:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740031400/0xb6207a6e76dcc0a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc0aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150910:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744272.150913:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150919:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.150921:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150938:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.150944:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.150949:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.150962:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150968:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.150972:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150978:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740030000/0xb6207a6e76dcc095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc09c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150989:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744272.150991:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.150997:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.151000:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151006:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.151013:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.151023:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.151036:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151042:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.151046:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151052:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc05d expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151062:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744272.151065:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151070:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744272.151073:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151079:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744272.151085:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744272.151089:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744272.151100:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151106:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744272.151116:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151122:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac775b82c00/0xb6207a6e76dcc02c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc033 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.151135:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744272.151137:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744272.151139:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744272.151152:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744272.151192:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744272.151208:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154428160:0@lo:103: 00000100:00100000:1.0:1788744272.151227:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154427776:0@lo:103: 00000100:00100000:1.0:1788744272.151848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.151892:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154428288:0@lo:103: 00000100:00100000:1.0:1788744272.151915:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.151932:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154428800:0@lo:103: 00000100:00100000:1.0:1788744272.151950:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.151980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154427904:0@lo:103: 00000100:00100000:1.0:1788744272.152001:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.152018:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154428416:0@lo:103: 00000100:00100000:1.0:1788744272.152036:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.152047:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744272.152053:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154428032:0@lo:103: 00000100:00100000:1.0:1788744272.152085:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.152098:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154428544:0@lo:103: 00000100:00100000:1.0:1788744272.152119:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.152182:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744272.152198:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744272.152223:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427776 00000100:00100000:1.0:1788744272.152230:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427776 00010000:00010000:1.0:1788744272.152266:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 24 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152285:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428288 00000100:00100000:1.0:1788744272.152288:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428288 00010000:00010000:1.0:1788744272.152299:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 25 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152309:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428800 00000100:00100000:1.0:1788744272.152312:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428800 00010000:00010000:1.0:1788744272.152322:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 26 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152331:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154427904 00000100:00100000:1.0:1788744272.152333:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154427904 00010000:00010000:1.0:1788744272.152341:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 27 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152350:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428416 00000100:00100000:1.0:1788744272.152352:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428416 00010000:00010000:1.0:1788744272.152372:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 28 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152384:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428032 00000100:00100000:1.0:1788744272.152387:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428032 00010000:00010000:1.0:1788744272.152397:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 29 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152433:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428544 00000100:00100000:1.0:1788744272.152436:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428544 00010000:00010000:1.0:1788744272.152445:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 30 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649344 00000100:00100000:1.0:1788744272.152464:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649344 00010000:00010000:1.0:1788744272.152475:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 10 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152483:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649216 00000100:00100000:1.0:1788744272.152485:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649216 00010000:00010000:1.0:1788744272.152493:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 11 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744272.152503:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744272.152510:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+30:3644:x1875634154427776:12345-0@lo:103: 00010000:00010000:1.0:1788744272.152521:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744272.152526:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 30 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.152536:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 30 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744272.155540:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744272.155594:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154428672:0@lo:103: 00000100:00100000:0.0:1788744272.155649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744272.155663:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428160 00000100:00100000:3.0:1788744272.155670:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428160 00000100:00100000:0.0:1788744272.155680:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428672 00000100:00100000:0.0:1788744272.155683:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428672 00010000:00010000:3.0:1788744272.155700:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 32 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.155700:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 32 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744272.155723:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744272.155730:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+32:3644:x1875634154428288:12345-0@lo:103: 00010000:00010000:0.0:1788744272.155755:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.155760:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 32 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744272.155860:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427264:0@lo:104: 00000100:00100000:2.0:1788744272.155908:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427392:0@lo:104: 00000100:00100000:2.0:1788744272.155917:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427520:0@lo:104: 00000100:00100000:2.0:1788744272.155925:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154427648:0@lo:104: 00000100:00100000:2.0:1788744272.155937:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426368:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744272.155946:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1875634154426496:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744272.159630:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 32 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.159681:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc0b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc0b1 expref: 32 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.159699:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744272.159802:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+31:3644:x1875634154428288:12345-0@lo:103: Request processed in 4070us (7884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744272.160310:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744272.160327:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+31:3644:x1875634154428800:12345-0@lo:103: 00010000:00010000:3.0:1788744272.160345:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744272.160358:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 31 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744272.160368:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 31 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744272.160380:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc02c expref: 31 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744272.160389:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744272.160435:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+30:3644:x1875634154428800:12345-0@lo:103: Request processed in 116us (8484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744272.160443:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744272.160472:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788744272.160480:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788744272.160770:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744272.160788:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744272.160796:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+28:3645:x1875634154427904:12345-0@lo:103: 00010000:00010000:0.0:1788744272.160806:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.160812:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 28 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.160822:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 28 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.160833:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031a00/0xb6207a6e76dcc11a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc113 expref: 28 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.160843:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744272.160882:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+27:3645:x1875634154427904:12345-0@lo:103: Request processed in 88us (8879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744272.160888:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744272.160902:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744272.160981:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+26:3645:x1875634154428416:12345-0@lo:103: 00010000:00010000:0.0:1788744272.160989:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.160994:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 26 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161010:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 26 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161020:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc0aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc0a3 expref: 26 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161030:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744272.161240:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3645:x1875634154428416:12345-0@lo:103: Request processed in 262us (9203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744272.161247:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744272.161261:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744272.161268:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154428032:12345-0@lo:103: 00010000:00010000:0.0:1788744272.161275:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.161280:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 24 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161286:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 24 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161295:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83600/0xb6207a6e76dcc0fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc0f7 expref: 24 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161371:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744272.161397:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+23:3645:x1875634154428032:12345-0@lo:103: Request processed in 130us (9311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744272.161421:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744272.161434:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744272.161440:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+22:3645:x1875634154428544:12345-0@lo:103: 00010000:00010000:0.0:1788744272.161456:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.161460:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 22 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161469:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 22 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161478:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc09c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc095 expref: 22 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.161486:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744272.161608:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154428032:0@lo:103: 00010000:00010000:1.0:1788744272.161659:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061aa00/0xb6207a6e76dcc144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc13d expref: 21 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.161670:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744272.161763:0:6503:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788744272.161775:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788744272.161783:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:2394:x1875634138649344:12345-192.168.203.4@tcp:103: 00010000:00010000:1.0:1788744272.161792:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744272.161797:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 11 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.161812:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 11 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.161822:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061a800/0xb6207a6e76dcc152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c1 expref: 11 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744272.161830:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744272.163753:0:10327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744272.163770:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3645:x1875634154428544:12345-0@lo:103: Request processed in 2327us (11646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744272.163780:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744272.163805:0:9517:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788744272.163818:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1788744272.163828:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138649216:12345-192.168.203.4@tcp:103: 00010000:00010000:0.0:1788744272.163844:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.163851:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 10 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.163865:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 10 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.163881:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2c8 expref: 10 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.163893:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744272.163960:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:2394:x1875634138649216:12345-192.168.203.4@tcp:103: Request processed in 134us (11760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744272.163978:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1788744272.163992:0:9517:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788744272.163998:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744272.164005:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3643:x1875634154428672:12345-0@lo:103: 00010000:00010000:0.0:1788744272.164014:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.164019:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164027:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164038:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4600/0xb6207a6e76dcc05d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc056 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164056:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744272.164095:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+18:3643:x1875634154428672:12345-0@lo:103: Request processed in 91us (8445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744272.164101:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744272.164112:0:9517:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788744272.164118:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744272.164363:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+17:3643:x1875634154428160:12345-0@lo:103: 00010000:00010000:0.0:1788744272.164386:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744272.164391:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 17 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164418:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 17 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164439:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc0d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc0cd expref: 17 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164450:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164457:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164472:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164479:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164486:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164493:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164499:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b83000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744272.164503:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.164512:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744272.164866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154427904:0@lo:103: 00000100:00100000:3.0:1788744272.164880:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154428416:0@lo:103: 00000100:00100000:3.0:1788744272.164904:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154428544:0@lo:103: 00000100:00100000:3.0:1788744272.166992:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154428288:0@lo:103: 00000100:00100000:3.0:1788744272.167007:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154428800:0@lo:103: 00000100:00100000:3.0:1788744272.167041:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154428672:0@lo:103: 00000100:00100000:1.0:1788744272.167841:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:2394:x1875634138649344:12345-192.168.203.4@tcp:103: Request processed in 6052us (15653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.167854:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788744272.167939:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:3644:x1875634154427776:12345-0@lo:103: Request processed in 15428us (16093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.167946:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744272.168190:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154427776:0@lo:103: 00010000:00010000:2.0:1788744272.170686:0:10327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744272.170706:0:10327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.178805:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.178842:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc198 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744272.178864:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744272.179179:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46c76a72-ee71-482d-9002-d7642a89bcb9+15:3643:x1875634154428160:12345-0@lo:103: Request processed in 15051us (23642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744272.179189:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744272.179344:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154428160:0@lo:103: 00010000:00010000:1.0:1788744272.238804:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744272.243176:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744272.243201:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154428928:0@lo:13: 00000100:00100000:2.0:1788744272.243265:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744272.243673:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154428928 00000100:00100000:3.0:1788744272.243691:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154428928 00000100:00100000:3.0:1788744272.243754:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744272.243764:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154428928:12345-0@lo:13: 00002000:00000024:3.0:1788744272.243802:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744272.243850:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154428928:12345-0@lo:13: Request processed in 89us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744272.243857:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788744272.244244:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc4000 x1875634154428928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744272.244264:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154428928:0@lo:13: 00000100:00100000:3.0:1788744272.753068:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744272.753095:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154429056:0@lo:13: 00000100:00100000:3.0:1788744272.753163:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744272.753428:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429056 00000100:00100000:1.0:1788744272.753437:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429056 00000100:00100000:1.0:1788744272.753485:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744272.753493:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154429056:12345-0@lo:13: 00002000:00000024:1.0:1788744272.753534:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744272.753594:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154429056:12345-0@lo:13: Request processed in 102us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744272.753601:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788744272.753863:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365c000 x1875634154429056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744272.753882:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154429056:0@lo:13: 00010000:00010000:1.0:1788744273.263248:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744273.774726:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744273.774744:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac642271000 from 48 10000000:01000000:0.0:1788744273.774749:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744273.774799:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.774812:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.774824:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744273.774847:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429184:0@lo:101: 00000100:00100000:0.0:1788744273.775020:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.775079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429184 00000100:00100000:0.0:1788744273.775083:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.775088:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429184 00000100:00100000:2.0:1788744273.775140:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788744273.775149:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+15:6513:x1875634154429184:12345-0@lo:101: 00010000:00010000:2.0:1788744273.775162:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744273.775176:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83a00/0xb6207a6e76dcc1a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc19f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.775216:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83a00/0xb6207a6e76dcc1a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc19f expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.775226:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83a00/0xb6207a6e76dcc1a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc19f expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.775235:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83a00, rc 0) 00000100:00100000:2.0:1788744273.775280:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154429184:12345-0@lo:101: Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.775287:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788744273.775458:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429184:0@lo:101: 00010000:00010000:0.0:1788744273.775472:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.775481:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744273.775702:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429312:0@lo:501: 00000100:00100000:0.0:1788744273.775729:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.775765:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.775872:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429312 00000100:00100000:3.0:1788744273.775877:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429312 00000100:00100000:3.0:1788744273.775918:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788744273.775926:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154429312:12345-0@lo:501: 00000100:00100000:3.0:1788744273.776045:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154429312:12345-0@lo:501: Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.776061:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788744273.776172:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429312:0@lo:501: 00000100:00100000:0.0:1788744273.776198:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429440:0@lo:503: 00000100:00100000:0.0:1788744273.777187:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.777491:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.779270:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744273.779294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154429568:0@lo:41: 00000100:00100000:2.0:1788744273.779353:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.779489:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429568 00000100:00100000:1.0:1788744273.779497:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429568 00000100:00100000:1.0:1788744273.779547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744273.779555:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154429568:12345-0@lo:41: 00000004:00000024:1.0:1788744273.779611:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744273.779661:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154429568:12345-0@lo:41: Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.779668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744273.779714:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154429568:0@lo:41: 00000100:00100000:3.0:1788744273.790030:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429440 00000100:00100000:3.0:1788744273.790045:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429440 00000100:00100000:3.0:1788744273.790163:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788744273.790173:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154429440:12345-0@lo:503: 00000100:00100000:3.0:1788744273.790342:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154429440:12345-0@lo:503: Request processed in 170us (13156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.790349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788744273.790455:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429440:0@lo:503: 00000100:00100000:1.0:1788744273.793814:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10345:1875634154429696:0@lo:502: 00000100:00100000:1.0:1788744273.793905:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.799582:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.812311:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429696 00000100:00100000:0.0:1788744273.812328:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429696 00000100:00100000:0.0:1788744273.812394:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788744273.812420:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10345:x1875634154429696:12345-0@lo:502: 00000100:00100000:0.0:1788744273.812611:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10345:x1875634154429696:12345-0@lo:502: Request processed in 207us (18705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.812619:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788744273.812812:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10345:1875634154429696:0@lo:502: 00000100:00100000:1.0:1788744273.812872:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10345:1875634154429824:0@lo:502: 00000100:00100000:1.0:1788744273.812924:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.812959:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.814834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429824 00000100:00100000:0.0:1788744273.814848:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429824 00000100:00100000:0.0:1788744273.814905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788744273.814914:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10345:x1875634154429824:12345-0@lo:502: 00000100:00100000:0.0:1788744273.815076:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:10345:x1875634154429824:12345-0@lo:502: Request processed in 163us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.815084:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788744273.815277:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10345:1875634154429824:0@lo:502: 00000040:00080000:1.0:1788744273.815311:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788744273.816391:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788744273.816449:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744273.816459:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.816489:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744273.816499:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788744273.816501:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788744273.816504:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788744273.816545:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.816553:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.816563:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744273.816880:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429952:0@lo:101: 00000100:00100000:0.0:1788744273.816937:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.816974:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.817144:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154429952 00000100:00100000:3.0:1788744273.817152:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154429952 00000100:00100000:3.0:1788744273.817196:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788744273.817205:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+16:6513:x1875634154429952:12345-0@lo:101: 00010000:00010000:3.0:1788744273.817217:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744273.817229:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061a400/0xb6207a6e76dcc1b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc1ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.817250:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061a400/0xb6207a6e76dcc1b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1ad expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.817260:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061a400/0xb6207a6e76dcc1b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1ad expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.817268:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061a400, rc 0) 00000100:00100000:3.0:1788744273.817312:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154429952:12345-0@lo:101: Request processed in 108us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.817319:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788744273.817397:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154429952:0@lo:101: 00010000:00010000:2.0:1788744273.817440:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.817447:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744273.817502:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430080:0@lo:501: 00000100:00100000:2.0:1788744273.817541:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.817578:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.817749:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430080 00000100:00100000:3.0:1788744273.817754:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430080 00000100:00100000:3.0:1788744273.817786:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788744273.817793:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154430080:12345-0@lo:501: 00000100:00100000:3.0:1788744273.817922:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154430080:12345-0@lo:501: Request processed in 129us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.817929:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788744273.818051:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430080:0@lo:501: 00000100:00100000:1.0:1788744273.818091:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430208:0@lo:503: 00000100:00100000:1.0:1788744273.818136:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.818155:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.818254:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430208 00000100:00100000:3.0:1788744273.818258:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430208 00000100:00100000:3.0:1788744273.818274:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788744273.818280:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154430208:12345-0@lo:503: 00000100:00100000:3.0:1788744273.818367:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154430208:12345-0@lo:503: Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.818374:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788744273.818719:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430208:0@lo:503: 00000100:00100000:0.0:1788744273.820312:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10346:1875634154430336:0@lo:502: 00000100:00100000:0.0:1788744273.820385:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.820453:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.823351:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430336 00000100:00100000:3.0:1788744273.823367:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430336 00000100:00100000:3.0:1788744273.823472:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788744273.823482:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10346:x1875634154430336:12345-0@lo:502: 00000100:00100000:3.0:1788744273.823644:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10346:x1875634154430336:12345-0@lo:502: Request processed in 164us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.823652:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788744273.823821:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10346:1875634154430336:0@lo:502: 00000020:01000000:0.0:1788744273.823855:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744273.823863:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744273.823866:0:10346:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744273.823871:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788744273.823917:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10346:1875634154430464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.823969:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.824005:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.824155:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430464 00000100:00100000:3.0:1788744273.824160:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430464 00000100:00100000:3.0:1788744273.824193:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788744273.824200:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10346:x1875634154430464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.824280:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:10346:x1875634154430464:12345-0@lo:502:llog_process_th.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.824287:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788744273.824360:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10346:1875634154430464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744273.824379:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744273.824388:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744273.824390:0:10346:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744273.824393:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788744273.824584:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788744273.824604:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788744273.824613:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.824624:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744273.824634:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744273.824636:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac77c9d5000 from 48 10000000:01000000:3.0:1788744273.824644:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744273.824668:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.824675:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.824684:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744273.824697:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.824725:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.824760:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744273.824803:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430592 00000100:00100000:1.0:1788744273.824807:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430592 00000100:00100000:1.0:1788744273.824827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788744273.824834:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+17:6513:x1875634154430592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744273.824843:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744273.824855:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcc1c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc1bb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.824875:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcc1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1bb expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.824885:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcc1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1bb expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.824903:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c5e00, rc 0) 00000100:00100000:1.0:1788744273.824940:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154430592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.824945:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788744273.826036:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744273.826078:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.826090:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744273.826166:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.826211:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.826242:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.826550:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430720 00000100:00100000:0.0:1788744273.826558:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430720 00000100:00100000:0.0:1788744273.826594:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788744273.826602:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154430720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.826744:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154430720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.826751:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788744273.829242:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.829311:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.829394:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.829472:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.829628:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430848 00000100:00100000:3.0:1788744273.829636:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430848 00000100:00100000:3.0:1788744273.829691:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788744273.829701:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154430848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.829818:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154430848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.829834:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788744273.832344:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154430848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.835724:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10347:1875634154430976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744273.835817:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.835860:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.835926:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154430976 00000100:00100000:3.0:1788744273.835934:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154430976 00000100:00100000:3.0:1788744273.835982:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788744273.835992:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10347:x1875634154430976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.836136:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10347:x1875634154430976:12345-0@lo:502:llog_process_th.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.836144:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788744273.836348:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10347:1875634154430976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.836395:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10347:1875634154431104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.836448:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.836471:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.836589:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431104 00000100:00100000:3.0:1788744273.836593:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431104 00000100:00100000:3.0:1788744273.838570:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788744273.838592:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10347:x1875634154431104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.838762:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+18:10347:x1875634154431104:12345-0@lo:502:llog_process_th.0 Request processed in 179us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.838770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788744273.843359:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10347:1875634154431104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788744273.843424:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788744273.854031:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788744273.854084:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744273.854097:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.854109:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744273.854119:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788744273.854122:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788744273.854124:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744273.854163:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.854184:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.854195:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744273.854219:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.854283:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.854317:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.854496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431232 00000100:00100000:0.0:1788744273.854504:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431232 00000100:00100000:0.0:1788744273.854557:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788744273.854575:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+18:6513:x1875634154431232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744273.854588:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744273.854602:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcc1d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc1c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.854623:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcc1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1c9 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.854633:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcc1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1c9 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.854652:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030000, rc 0) 00000100:00100000:0.0:1788744273.854697:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154431232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.854704:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788744273.854996:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744273.855011:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.855020:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744273.855134:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.855162:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.855193:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.855245:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431360 00000100:00100000:0.0:1788744273.855250:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431360 00000100:00100000:0.0:1788744273.855308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788744273.855316:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154431360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.855466:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154431360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.855473:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788744273.855543:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.855582:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.855624:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.872916:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.873130:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431488 00000100:00100000:3.0:1788744273.873140:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431488 00000100:00100000:3.0:1788744273.880253:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788744273.880267:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154431488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.880455:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154431488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (24829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.880464:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788744273.884445:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.885336:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10348:1875634154431616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.885437:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.885471:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.893216:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431616 00000100:00100000:3.0:1788744273.893232:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431616 00000100:00100000:3.0:1788744273.893292:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788744273.893302:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:10348:x1875634154431616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.893476:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:10348:x1875634154431616:12345-0@lo:502:llog_process_th.0 Request processed in 175us (8039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.893484:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788744273.894145:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10348:1875634154431616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744273.894186:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744273.894196:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744273.894198:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744273.894202:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788744273.894235:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10348:1875634154431744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.894281:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.894319:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744273.894467:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431744 00000100:00100000:1.0:1788744273.894474:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431744 00000100:00100000:1.0:1788744273.894501:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788744273.894509:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+19:10348:x1875634154431744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744273.894593:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+19:10348:x1875634154431744:12345-0@lo:502:llog_process_th.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.894601:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788744273.894817:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10348:1875634154431744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744273.894835:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744273.894844:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744273.894846:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788744273.894849:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788744273.895080:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788744273.895103:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788744273.895113:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.895124:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744273.895134:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788744273.895137:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac774b65800 from 48 10000000:01000000:1.0:1788744273.895139:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744273.895163:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.895171:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.895179:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744273.895193:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.895222:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.895257:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.895348:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154431872 00000100:00100000:0.0:1788744273.895352:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154431872 00000100:00100000:0.0:1788744273.895384:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788744273.895392:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+19:6513:x1875634154431872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744273.895426:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744273.895437:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcc1de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.895458:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcc1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1d7 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.895467:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcc1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1d7 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.895475:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031400, rc 0) 00000100:00100000:0.0:1788744273.895508:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154431872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.895514:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788744273.895637:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154431872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744273.895649:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.895657:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744273.895714:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.895749:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.895764:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.896049:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432000 00000100:00100000:2.0:1788744273.896065:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432000 00000100:00100000:2.0:1788744273.896098:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788744273.896105:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154432000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.896213:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154432000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.896219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788744273.896332:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.896360:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.896430:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.896453:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.896501:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432128 00000100:00100000:3.0:1788744273.896505:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432128 00000100:00100000:3.0:1788744273.896529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788744273.896535:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154432128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.896614:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154432128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.896621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788744273.897237:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.898088:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10349:1875634154432256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744273.898149:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.898184:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.898433:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432256 00000100:00100000:3.0:1788744273.898441:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432256 00000100:00100000:3.0:1788744273.898475:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788744273.898483:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10349:x1875634154432256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.898585:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10349:x1875634154432256:12345-0@lo:502:llog_process_th.0 Request processed in 102us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.898592:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788744273.902070:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10349:1875634154432256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744273.902168:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10349:1875634154432384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744273.902238:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.902271:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.902664:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432384 00000100:00100000:3.0:1788744273.902673:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432384 00000100:00100000:3.0:1788744273.902728:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788744273.902747:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10349:x1875634154432384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.902866:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:10349:x1875634154432384:12345-0@lo:502:llog_process_th.0 Request processed in 120us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.902879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788744273.904244:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10349:1875634154432384:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788744273.904282:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788744273.910095:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788744273.910133:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744273.910145:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.910157:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744273.910169:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788744273.910171:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788744273.910174:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788744273.910213:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.910221:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.910232:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744273.910257:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.910322:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.910368:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.910553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432512 00000100:00100000:2.0:1788744273.910561:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432512 00000100:00100000:2.0:1788744273.910601:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788744273.910611:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154432512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744273.910625:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744273.910649:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83c00/0xb6207a6e76dcc1ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc1e5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.910672:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83c00/0xb6207a6e76dcc1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1e5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.910682:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83c00/0xb6207a6e76dcc1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1e5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.910691:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83c00, rc 0) 00000100:00100000:2.0:1788744273.910749:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154432512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.910756:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788744273.910828:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744273.910842:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744273.910850:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744273.910915:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.910950:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.910972:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.911070:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432640 00000100:00100000:2.0:1788744273.911074:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432640 00000100:00100000:2.0:1788744273.911104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788744273.911111:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154432640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.911215:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154432640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.911222:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788744273.911323:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.911351:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.911390:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.911431:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.911655:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432768 00000100:00100000:2.0:1788744273.911660:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432768 00000100:00100000:2.0:1788744273.911689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788744273.911696:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154432768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.911782:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154432768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.911788:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788744273.911857:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154432768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.912273:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10350:1875634154432896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.912308:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.912331:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.912392:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154432896 00000100:00100000:3.0:1788744273.912426:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154432896 00000100:00100000:3.0:1788744273.912454:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788744273.912462:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10350:x1875634154432896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.912544:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10350:x1875634154432896:12345-0@lo:502:llog_process_th.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.912557:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788744273.912657:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10350:1875634154432896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744273.912679:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744273.912688:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744273.912690:0:10350:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744273.912696:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788744273.912714:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10350:1875634154433024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.912756:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.912774:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.912826:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433024 00000100:00100000:2.0:1788744273.912836:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433024 00000100:00100000:2.0:1788744273.912867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788744273.912874:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10350:x1875634154433024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744273.912946:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10350:x1875634154433024:12345-0@lo:502:llog_process_th.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.912952:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788744273.913076:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10350:1875634154433024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744273.913092:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744273.913096:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744273.913098:0:10350:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788744273.913101:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788744273.913438:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788744273.913461:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788744273.913470:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.913482:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744273.913493:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788744273.913495:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac75196e800 from 48 10000000:01000000:2.0:1788744273.913497:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744273.913522:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.913529:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.913538:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744273.913551:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.913581:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.913599:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744273.913663:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433152 00000100:00100000:3.0:1788744273.913668:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433152 00000100:00100000:3.0:1788744273.913701:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788744273.913707:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154433152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744273.913716:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744273.913727:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc1fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc1f3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.913757:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1f3 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.913768:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc1f3 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744273.913787:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061b400, rc 0) 00000100:00100000:3.0:1788744273.913817:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154433152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.913823:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788744273.914008:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744273.914021:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.914029:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744273.914083:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.914108:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.914135:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.914222:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433280 00000100:00100000:0.0:1788744273.914227:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433280 00000100:00100000:0.0:1788744273.914266:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788744273.914272:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154433280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.914363:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154433280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.914370:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788744273.915162:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.915198:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.915245:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.915278:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744273.916118:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433408 00000100:00100000:0.0:1788744273.916127:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433408 00000100:00100000:0.0:1788744273.916168:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788744273.916178:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154433408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.916290:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154433408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744273.916296:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788744273.916544:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744273.917339:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10351:1875634154433536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744273.917392:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744273.917531:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.919090:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433536 00000100:00100000:2.0:1788744273.919102:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433536 00000100:00100000:2.0:1788744273.919153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788744273.919163:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10351:x1875634154433536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744273.919321:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10351:x1875634154433536:12345-0@lo:502:llog_process_th.0 Request processed in 159us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.919329:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788744273.919488:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10351:1875634154433536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.919540:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10351:1875634154433664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.919577:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.919611:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744273.919858:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433664 00000100:00100000:1.0:1788744273.919864:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433664 00000100:00100000:1.0:1788744273.919901:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788744273.919909:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10351:x1875634154433664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744273.919992:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10351:x1875634154433664:12345-0@lo:502:llog_process_th.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.920008:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788744273.920199:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10351:1875634154433664:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788744273.920220:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788744273.921549:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788744273.921578:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744273.921590:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.921602:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744273.921613:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788744273.921616:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788744273.921619:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788744273.921653:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.921662:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.921672:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744273.921692:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.921754:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.921798:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744273.923568:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433792 00000100:00100000:1.0:1788744273.923582:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433792 00000100:00100000:1.0:1788744273.923634:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788744273.923644:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154433792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744273.923661:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744273.923692:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc201 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.923719:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc201 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.923742:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc201 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.923752:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c4c00, rc 0) 00000100:00100000:1.0:1788744273.923821:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154433792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.923827:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788744273.923879:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744273.927716:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744273.927745:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744273.927858:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.927934:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.927977:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.928087:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154433920 00000100:00100000:2.0:1788744273.928096:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154433920 00000100:00100000:2.0:1788744273.928148:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788744273.928158:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154433920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.928297:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154433920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.928304:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788744273.928382:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154433920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.928436:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154434048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744273.928473:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.928490:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b97a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.928599:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434048 00000100:00100000:2.0:1788744273.928604:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434048 00000100:00100000:2.0:1788744273.928625:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788744273.928633:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154434048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.928707:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154434048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.928714:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788744273.932844:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154434048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744273.934590:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10352:1875634154434176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.934678:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.934721:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.934783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434176 00000100:00100000:2.0:1788744273.934792:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434176 00000100:00100000:2.0:1788744273.934842:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788744273.934851:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10352:x1875634154434176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744273.934982:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10352:x1875634154434176:12345-0@lo:502:llog_process_th.0 Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.934989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788744273.935135:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10352:1875634154434176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744273.935163:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744273.935171:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744273.935173:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788744273.935178:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788744273.935199:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10352:1875634154434304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.935234:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744273.935259:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744273.935366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744273.935837:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434304 00000100:00100000:3.0:1788744273.935853:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434304 00000100:00100000:3.0:1788744273.935887:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649472 00000100:00100000:3.0:1788744273.935890:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649472 00000100:00100000:3.0:1788744273.935914:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788744273.935920:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10352:x1875634154434304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744273.936007:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10352:x1875634154434304:12345-0@lo:502:llog_process_th.0 Request processed in 86us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.936014:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788744273.936044:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:3.0:1788744273.936051:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:2397:x1875634138649472:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788744273.936093:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:2397:x1875634138649472:12345-192.168.203.4@tcp:400: Request processed in 43us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744273.936100:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:3.0:1788744273.936129:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10352:1875634154434304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744273.936150:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744273.936159:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744273.936161:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788744273.936165:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1788744273.936671:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744273.936701:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744273.936725:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744273.936763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744273.936798:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649984 00000100:00100000:1.0:1788744273.936803:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649984 00000100:00100000:1.0:1788744273.936842:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649856 00000100:00100000:1.0:1788744273.936845:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649856 00000100:00100000:1.0:1788744273.936866:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788744273.936875:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138649984:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788744273.937028:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138649984:12345-192.168.203.4@tcp:400: Request processed in 154us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.937036:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788744273.937051:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788744273.937058:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138649856:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788744273.937084:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138649856:12345-192.168.203.4@tcp:400: Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.937090:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788744273.937108:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649728 00000100:00100000:1.0:1788744273.937112:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649728 00000100:00100000:1.0:1788744273.937138:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138649600 00000100:00100000:1.0:1788744273.937141:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138649600 00000100:00100000:1.0:1788744273.937163:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788744273.937170:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138649728:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788744273.937196:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138649728:12345-192.168.203.4@tcp:400: Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.937212:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788744273.937225:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788744273.937232:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138649600:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788744273.937258:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138649600:12345-192.168.203.4@tcp:400: Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.937264:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00080000:1.0:1788744273.937283:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744273.937287:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788744273.937289:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744273.937291:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:2.0:1788744273.937596:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1788744273.937625:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744273.937634:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.937647:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744273.937657:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788744273.937660:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac750753380 from 1 10000000:01000000:2.0:1788744273.937669:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744273.937697:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.937706:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.937715:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744273.937748:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154434432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.937803:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.937831:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434432 00000100:00100000:2.0:1788744273.937835:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434432 00000100:00100000:2.0:1788744273.937860:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788744273.937867:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154434432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744273.937877:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744273.937888:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b82200/0xb6207a6e76dcc216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.938035:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b82200/0xb6207a6e76dcc216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc20f expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.938047:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b82200/0xb6207a6e76dcc216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc20f expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.938056:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82200, rc 0) 00000100:00100000:2.0:1788744273.938082:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154434432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.938089:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788744273.938133:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.938150:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154434432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744273.938165:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.938173:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744273.938224:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154434560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.938248:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744273.938266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434560 00000100:00100000:2.0:1788744273.938270:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434560 00000100:00100000:2.0:1788744273.938289:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788744273.938296:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154434560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744273.938356:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154434560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (107us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744273.938363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788744273.938383:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744273.938392:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154434560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788744273.938717:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788744273.938724:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744273.938742:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744274.287547:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744274.799150:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744274.799177:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154434688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744274.799250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744274.801190:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434688 00000100:00100000:0.0:1788744274.801203:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434688 00000100:00100000:0.0:1788744274.801277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744274.801294:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154434688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744274.801328:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744274.801423:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154434688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744274.801430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744274.801467:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154434688:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788744275.314785:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744276.108759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744276.108883:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650112 00000100:00100000:2.0:1788744276.108906:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650112 00000100:00100000:2.0:1788744276.108971:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:2.0:1788744276.108982:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:6165:x1875634138650112:12345-192.168.203.4@tcp:101: 00010000:00010000:2.0:1788744276.108999:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744276.109017:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83400/0xb6207a6e76dcc21d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d338 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.109045:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83400/0xb6207a6e76dcc21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d338 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.109056:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83400/0xb6207a6e76dcc21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d338 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.109064:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83400, rc 0) 00000100:00100000:2.0:1788744276.109119:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138650112:12345-192.168.203.4@tcp:101: Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.109125:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:2.0:1788744276.112769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744276.112868:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650240 00000100:00100000:0.0:1788744276.112878:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650240 00000100:00100000:0.0:1788744276.112931:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:0.0:1788744276.112954:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138650240:12345-192.168.203.4@tcp:501: 00000100:00100000:0.0:1788744276.113104:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138650240:12345-192.168.203.4@tcp:501: Request processed in 151us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744276.113112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:1.0:1788744276.120533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744276.120622:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650368 00000100:00100000:0.0:1788744276.120633:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650368 00000100:00100000:0.0:1788744276.120686:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:0.0:1788744276.120696:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138650368:12345-192.168.203.4@tcp:503: 00000100:00100000:0.0:1788744276.120847:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138650368:12345-192.168.203.4@tcp:503: Request processed in 152us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744276.120855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:1.0:1788744276.123676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744276.123928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650496 00000100:00100000:2.0:1788744276.123937:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650496 00000100:00100000:2.0:1788744276.123985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:2.0:1788744276.123994:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6659:x1875634138650496:12345-192.168.203.4@tcp:502: 00000100:00100000:2.0:1788744276.124125:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6659:x1875634138650496:12345-192.168.203.4@tcp:502: Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.124133:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:2.0:1788744276.132998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744276.133075:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650624 00000100:00100000:3.0:1788744276.133086:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650624 00000100:00100000:3.0:1788744276.133133:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:3.0:1788744276.133142:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6659:x1875634138650624:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744276.133281:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6659:x1875634138650624:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 130us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.133295:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:1.0:1788744276.137826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744276.143739:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650752 00000100:00100000:0.0:1788744276.143753:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650752 00000100:00100000:0.0:1788744276.143816:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:0.0:1788744276.143826:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138650752:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744276.143841:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744276.143858:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d33f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.143884:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d33f expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.143895:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d33f expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.143904:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030200, rc 0) 00000100:00100000:0.0:1788744276.143966:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138650752:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 140us (6148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744276.143984:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:1.0:1788744276.145959:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744276.146030:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138650880 00000100:00100000:2.0:1788744276.146039:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138650880 00000100:00100000:2.0:1788744276.146094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:2.0:1788744276.146103:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138650880:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744276.146205:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138650880:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 104us (252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744276.146212:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:1.0:1788744276.334824:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154435072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.334880:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744276.334927:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154435584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.334942:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744276.334958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154436096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.334970:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744276.334986:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788744276.334989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154435200:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.334999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744276.335022:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154435712:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.335037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744276.335048:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154436224:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.335058:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744276.335080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435584 00000100:00100000:1.0:1788744276.335087:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435584 00000100:00100000:1.0:1788744276.335135:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436096 00000100:00100000:1.0:1788744276.335138:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436096 00000100:00100000:1.0:1788744276.335152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435200 00000100:00100000:1.0:1788744276.335154:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435200 00000100:00100000:1.0:1788744276.335174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744276.335184:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154435584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.335240:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154435584:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744276.335247:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744276.335262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744276.335268:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744276.335444:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435072 00000100:00100000:2.0:1788744276.335449:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435072 00000100:00100000:2.0:1788744276.335480:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744276.335487:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154435072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744276.335522:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154435072:12345-0@lo:400:kworker.0 Request processed in 35us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.335528:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744276.335568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744276.335575:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154435200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744276.335603:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154435200:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.335608:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744276.335627:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435712 00000100:00100000:2.0:1788744276.335629:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435712 00000100:00100000:2.0:1788744276.335645:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436224 00000100:00100000:2.0:1788744276.335647:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436224 00000100:00100000:2.0:1788744276.335657:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744276.335660:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744276.335680:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154435712:12345-0@lo:400:kworker.0 Request processed in 20us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.335683:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744276.335698:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744276.335702:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154436224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744276.335736:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154436224:12345-0@lo:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.335741:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788744276.335771:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744276.335775:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744276.335777:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744276.335802:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154435200:0@lo:400:kworker.0 00010000:00080000:2.0:1788744276.335810:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365fb80 x1875634154435712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744276.335817:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154435712:0@lo:400:kworker.0 00010000:00080000:2.0:1788744276.335822:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365df80 x1875634154436224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744276.335827:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154436224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744276.335833:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154435072:0@lo:400:kworker.0 00010000:00080000:2.0:1788744276.335838:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365ce00 x1875634154435584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744276.335842:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154435584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.335997:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154436096:12345-0@lo:400:kworker.0 Request processed in 729us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744276.336002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744276.336055:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154434816:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336088:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336124:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154435328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336150:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336171:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154435840:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336197:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336212:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154436352:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336230:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336249:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788744276.336254:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154434944:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336273:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336497:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336515:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744276.336557:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434944 00000100:00100000:3.0:1788744276.336563:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434944 00000100:00100000:3.0:1788744276.336583:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435456 00000100:00100000:3.0:1788744276.336585:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435456 00000100:00100000:3.0:1788744276.336604:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435968 00000100:00100000:3.0:1788744276.336607:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435968 00000100:00100000:3.0:1788744276.336621:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744276.336627:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336663:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154434944:12345-0@lo:400:kworker.0 Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.336669:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744276.336683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744276.336688:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154435456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336724:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154435456:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.336730:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744276.336742:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744276.336748:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154435968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336773:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154435968:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.336777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744276.336792:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435840 00000100:00100000:3.0:1788744276.336796:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435840 00000100:00100000:3.0:1788744276.336824:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436352 00000100:00100000:3.0:1788744276.336828:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436352 00000100:00100000:3.0:1788744276.336845:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744276.336851:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336880:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154435840:12345-0@lo:400:kworker.0 Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.336885:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744276.336896:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744276.336902:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.336928:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154436352:12345-0@lo:400:kworker.0 Request processed in 26us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.336933:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788744276.336952:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744276.336955:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744276.336957:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744276.336971:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154435328 00000100:00100000:3.0:1788744276.336974:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154435328 00000100:00100000:3.0:1788744276.336997:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744276.337003:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154435328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.337034:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154435328:12345-0@lo:400:kworker.0 Request processed in 31us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.337040:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744276.337080:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154434944:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.337089:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.337098:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744276.337107:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154435328:0@lo:400:kworker.0 00010000:00080000:3.0:1788744276.337127:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365ed80 x1875634154435840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744276.337135:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154435840:0@lo:400:kworker.0 00010000:00080000:3.0:1788744276.337145:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365c000 x1875634154436352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744276.337153:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154436352:0@lo:400:kworker.0 00010000:00080000:2.0:1788744276.337568:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365dc00 x1875634154436096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744276.337579:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154436096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.339322:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154434816 00000100:00100000:1.0:1788744276.339334:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154434816 00000100:00100000:1.0:1788744276.339393:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788744276.339416:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154434816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744276.339496:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154434816:12345-0@lo:400:kworker.0 Request processed in 95us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744276.339504:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788744276.339562:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154434816:0@lo:400:kworker.0 00010000:00010000:2.0:1788744276.339837:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744276.849918:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154436480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744276.849999:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744276.850078:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436480 00000100:00100000:0.0:1788744276.850085:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436480 00000100:00100000:0.0:1788744276.850132:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744276.850141:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154436480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744276.850172:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744276.850219:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154436480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744276.850227:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788744276.850270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdcb480 x1875634154436480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744276.850299:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154436480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744276.851957:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744276.851972:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154436608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744276.852052:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744276.854204:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436608 00000100:00100000:0.0:1788744276.854216:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436608 00000100:00100000:0.0:1788744276.854267:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744276.854275:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154436608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744276.854311:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744276.854377:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154436608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744276.854384:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788744276.854576:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365dc00 x1875634154436608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744276.854595:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154436608:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788744277.359925:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744277.360247:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154436736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744277.360311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744277.360785:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436736 00000100:00100000:2.0:1788744277.360795:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436736 00000100:00100000:2.0:1788744277.360848:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744277.360858:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154436736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744277.360891:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744277.360948:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154436736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744277.360955:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788744277.361025:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365d180 x1875634154436736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744277.361043:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154436736:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1788744277.703003:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3d9b2bf0 20000000:00000080:0.0:1788744277.703021:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac6436f7800 uarg=0000000000000000 20000000:01000000:0.0:1788744277.703329:0:10390:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788744277.703335:0:10390:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788744277.703339:0:10390:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788744277.703936:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788744277.706852:0:10390:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788744277.716668:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788744277.716732:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788744277.716752:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788744277.716771:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788744277.716790:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716809:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716818:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716825:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716831:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716843:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716849:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716888:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.716919:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 9 pid: 6510 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.716934:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154436864:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744277.717042:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.717051:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 23 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.717061:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154436992:0@lo:104: 00000100:00100000:0.0:1788744277.717113:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744277.717143:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.717152:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 23 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.717160:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154437120:0@lo:104: 00000100:00100000:0.0:1788744277.717184:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744277.717204:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.717212:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 23 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.717220:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154437248:0@lo:104: 00010000:00010000:0.0:1788744277.717245:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744277.717260:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 23 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.717268:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154437376:0@lo:104: 00000100:00100000:0.0:1788744277.717301:0:10390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744277.717810:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788744277.717840:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744277.717855:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744277.717863:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154436992 00000100:00100000:1.0:1788744277.717870:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154436992 00000100:00100000:1.0:1788744277.717908:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437120 00000100:00100000:1.0:1788744277.717911:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437120 00000100:00100000:1.0:1788744277.717922:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437248 00000100:00100000:1.0:1788744277.717924:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437248 00000100:00100000:1.0:1788744277.717931:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437376 00000100:00100000:1.0:1788744277.717933:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437376 00000100:00100000:1.0:1788744277.717946:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744277.717953:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:10390:x1875634154436992:12345-0@lo:104: 00010000:00010000:1.0:1788744277.717964:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718023:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744277.718029:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:10390:x1875634154436992:12345-0@lo:104: Request processed in 77us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.718043:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744277.718061:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744277.718067:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:10390:x1875634154437120:12345-0@lo:104: 00010000:00010000:1.0:1788744277.718074:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718175:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744277.718181:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:10390:x1875634154437120:12345-0@lo:104: Request processed in 115us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.718187:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744277.718216:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744277.718223:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:10390:x1875634154437248:12345-0@lo:104: 00010000:00010000:1.0:1788744277.718230:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718264:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788744277.718268:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:10390:x1875634154437248:12345-0@lo:104: Request processed in 47us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.718273:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744277.718284:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744277.718290:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:10390:x1875634154437376:12345-0@lo:104: 00010000:00010000:1.0:1788744277.718297:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718323:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788744277.718328:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:10390:x1875634154437376:12345-0@lo:104: Request processed in 39us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.718340:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788744277.718359:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788744277.718365:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718372:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744277.718376:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718384:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744277.718391:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744277.718396:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744277.718446:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718452:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744277.718473:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718480:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc04f expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718495:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744277.718498:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718515:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744277.718518:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718525:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744277.718531:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744277.718536:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744277.718549:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718555:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744277.718562:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718567:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcbf22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbf29 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718577:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744277.718580:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718586:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535e00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744277.718589:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718605:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744277.718612:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744277.718617:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744277.718630:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718636:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744277.718652:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718659:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcbec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718668:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744277.718671:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718676:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061b000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744277.718679:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718686:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744277.718692:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744277.718703:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744277.718728:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718734:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744277.718740:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718747:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061b000/0xb6207a6e76dcbe6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcbe73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.718760:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744277.718762:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744277.718763:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744277.718771:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744277.718781:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154437504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.718822:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744277.718855:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744277.718862:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154437632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.718886:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744277.718913:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154437760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.718933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744277.718949:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744277.718955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154437888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.718980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744277.719006:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437504 00000100:00100000:1.0:1788744277.719010:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437504 00010000:00010000:1.0:1788744277.719037:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 24 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744277.719058:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437632 00000100:00100000:1.0:1788744277.719061:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437632 00010000:00010000:1.0:1788744277.719072:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 25 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744277.719081:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437760 00000100:00100000:1.0:1788744277.719083:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437760 00010000:00010000:1.0:1788744277.719100:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 26 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744277.719112:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154437888 00000100:00100000:1.0:1788744277.719115:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154437888 00010000:00010000:1.0:1788744277.719124:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 27 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744277.719136:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744277.719143:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+27:3645:x1875634154437504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744277.719152:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744277.719157:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 27 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719166:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 27 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719181:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744277.719211:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+27:3645:x1875634154437504:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.719217:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744277.719237:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744277.719243:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+26:3645:x1875634154437632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744277.719250:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744277.719255:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 26 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719263:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 26 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719272:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744277.719294:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+26:3645:x1875634154437632:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.719300:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744277.719313:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744277.719319:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3643:x1875634154437760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744277.719326:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744277.719330:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 25 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719338:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 25 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719347:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744277.719372:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3643:x1875634154437760:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.719378:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744277.719390:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744277.719396:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154437888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744277.719435:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744277.719440:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 24 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719448:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 24 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.719456:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744277.719476:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154437888:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.719482:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744277.719539:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154437888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.719548:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154437760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.719568:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154437632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744277.719575:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154437504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744277.720268:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc04f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc048 expref: 23 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.720281:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154436992:0@lo:104: 00010000:00010000:0.0:1788744277.720291:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4200/0xb6207a6e76dcbf29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbf22 expref: 22 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.720298:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154437120:0@lo:104: 00010000:00010000:0.0:1788744277.720307:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741534200/0xb6207a6e76dcbec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbec0 expref: 21 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.720314:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154437248:0@lo:104: 00010000:00010000:0.0:1788744277.720324:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4400/0xb6207a6e76dcbe73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcbe6c expref: 20 pid: 6511 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744277.720331:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154437376:0@lo:104: 00010000:00010000:3.0:1788744277.723768:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744277.727520:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875634154436864:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744277.727581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1788744277.727667:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744277.727746:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651008 00000100:00100000:1.0:1788744277.727755:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651008 00010000:00010000:1.0:1788744277.727789:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 10 pid: 6510 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744277.727835:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788744277.727860:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138651008:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744277.727875:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744277.727882:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 10 pid: 6510 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727912:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 10 pid: 6510 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727930:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d300 expref: 10 pid: 6510 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727947:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727955:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727970:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727977:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727984:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727991:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.727997:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744277.728001:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.728015:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.728048:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744277.728068:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744277.728133:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:2394:x1875634138651008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 280us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744277.728141:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00010000:00010000:3.0:1788744277.728216:0:10390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744277.728226:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744277.728234:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc22b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744277.871240:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744277.871264:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744277.871338:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744277.871428:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438016 00000100:00100000:2.0:1788744277.871436:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438016 00000100:00100000:2.0:1788744277.871498:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744277.871509:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154438016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744277.871532:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744277.871578:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744277.871586:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788744277.871630:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365df80 x1875634154438016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744277.871650:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154438016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744278.383966:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744278.769823:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744278.769845:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac642271000 from 4 10000000:01000000:2.0:1788744278.769850:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744278.769904:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744278.769916:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744278.769933:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744278.769959:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744278.770025:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744278.770078:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.770304:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438144 00000100:00100000:1.0:1788744278.770312:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438144 00000100:00100000:1.0:1788744278.770366:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788744278.770376:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154438144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744278.770389:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744278.770428:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc232 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.770454:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.770464:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.770473:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c5a00, rc 0) 00000100:00100000:1.0:1788744278.770523:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154438144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.770530:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788744278.770853:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744278.770878:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744278.770885:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744278.770960:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744278.770985:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744278.771008:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.771230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438272 00000100:00100000:1.0:1788744278.771236:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438272 00000100:00100000:1.0:1788744278.771267:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788744278.771291:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154438272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.771435:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154438272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.771442:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788744278.771668:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.771708:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.771747:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744278.771768:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.771838:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438400 00000100:00100000:1.0:1788744278.771843:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438400 00000100:00100000:1.0:1788744278.771879:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788744278.771886:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154438400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.773971:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154438400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2078us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.773985:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788744278.774110:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.775514:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10416:1875634154438528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.775570:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.775600:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac748b1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744278.775720:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438528 00000100:00100000:3.0:1788744278.775728:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438528 00000100:00100000:3.0:1788744278.775769:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788744278.775778:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10416:x1875634154438528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744278.775892:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10416:x1875634154438528:12345-0@lo:502:llog_process_th.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744278.775900:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788744278.776039:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10416:1875634154438528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744278.776068:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744278.776077:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744278.776079:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744278.776085:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac642271000 00000020:00000080:2.0:1788744278.776093:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744278.776234:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10416:1875634154438656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744278.776267:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744278.781998:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.782640:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438656 00000100:00100000:1.0:1788744278.782653:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438656 00000100:00100000:1.0:1788744278.782712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788744278.782722:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10416:x1875634154438656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.782872:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:10416:x1875634154438656:12345-0@lo:502:llog_process_th.0 Request processed in 151us (6603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.782878:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788744278.788575:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10416:1875634154438656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744278.788624:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744278.788632:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744278.788634:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788744278.788642:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788744278.788715:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788744278.788737:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744278.788746:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.788758:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744278.788768:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744278.788770:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac77c9d5000 from 4 10000000:01000000:3.0:1788744278.788773:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744278.788805:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.788812:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.788821:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744278.788842:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.788907:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744278.788947:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.790118:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438784 00000100:00100000:1.0:1788744278.790127:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438784 00000100:00100000:1.0:1788744278.790187:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788744278.790197:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154438784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744278.790211:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744278.790233:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.790258:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.790269:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.790387:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac75e2c4a00, rc 0) 00000100:00100000:1.0:1788744278.790467:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154438784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.790474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788744278.790530:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744278.790545:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.790554:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744278.790616:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.790643:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.790666:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.790676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154438912 00000100:00100000:1.0:1788744278.790679:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154438912 00000100:00100000:1.0:1788744278.790695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788744278.790712:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154438912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.790807:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154438912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.790821:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788744278.790849:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154438912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.790876:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.790912:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.790924:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.791058:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439040 00000100:00100000:1.0:1788744278.791063:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439040 00000100:00100000:1.0:1788744278.791081:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788744278.791086:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154439040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.791362:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154439040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.791368:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788744278.794833:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.795657:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10421:1875634154439168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.795735:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.795780:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744278.797366:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439168 00000100:00100000:3.0:1788744278.797376:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439168 00000100:00100000:3.0:1788744278.797440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788744278.797450:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10421:x1875634154439168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744278.797588:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10421:x1875634154439168:12345-0@lo:502:llog_process_th.0 Request processed in 139us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744278.797596:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788744278.797645:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10421:1875634154439168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744278.797683:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744278.797692:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744278.797694:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788744278.797710:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac77c9d5000 00000020:00000080:0.0:1788744278.797713:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744278.797789:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10421:1875634154439296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744278.797827:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744278.797857:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744278.799059:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439296 00000100:00100000:2.0:1788744278.799068:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439296 00000100:00100000:2.0:1788744278.799180:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788744278.799189:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10421:x1875634154439296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744278.799367:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:10421:x1875634154439296:12345-0@lo:502:llog_process_th.0 Request processed in 179us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744278.799375:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788744278.799648:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10421:1875634154439296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744278.799678:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744278.799684:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744278.799686:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788744278.799690:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788744278.800132:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788744278.800150:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744278.800160:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.800171:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744278.800180:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744278.800194:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac774b65800 from 4 10000000:01000000:1.0:1788744278.800196:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744278.800227:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.800236:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.800245:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744278.800268:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.800306:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.800340:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744278.800356:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439424 00000100:00100000:0.0:1788744278.800361:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439424 00000100:00100000:0.0:1788744278.800385:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788744278.800391:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154439424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744278.800417:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744278.800428:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc24e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744278.800448:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744278.800458:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744278.800466:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031000, rc 0) 00000100:00100000:0.0:1788744278.800508:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154439424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744278.800520:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788744278.800551:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744278.800565:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744278.800573:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744278.800621:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744278.800643:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744278.800659:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744278.800669:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439552 00000100:00100000:0.0:1788744278.800672:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439552 00000100:00100000:0.0:1788744278.800688:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788744278.800694:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154439552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744278.800786:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154439552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744278.800792:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788744278.800813:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744278.800834:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744278.800863:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744278.800873:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744278.800882:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439680 00000100:00100000:0.0:1788744278.800885:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439680 00000100:00100000:0.0:1788744278.800898:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788744278.800907:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154439680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744278.800964:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154439680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744278.800970:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788744278.801001:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154439680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744278.805455:0:10422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10422:1875634154439808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744278.805608:0:10422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744278.805644:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439808 00000100:00100000:0.0:1788744278.805651:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439808 00000100:00100000:0.0:1788744278.805690:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788744278.805710:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10422:x1875634154439808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744278.805812:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10422:x1875634154439808:12345-0@lo:502:llog_process_th.0 Request processed in 113us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744278.805820:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788744278.805869:0:10422:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744278.805887:0:10422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10422:1875634154439808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744278.805915:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744278.805924:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744278.805926:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788744278.805933:0:10422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac774b65800 00000020:00000080:0.0:1788744278.805935:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744278.807788:0:10422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10422:1875634154439936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744278.807852:0:10422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744278.807887:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154439936 00000100:00100000:0.0:1788744278.807894:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154439936 00000100:00100000:0.0:1788744278.807939:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788744278.807946:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10422:x1875634154439936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744278.808030:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:10422:x1875634154439936:12345-0@lo:502:llog_process_th.0 Request processed in 84us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744278.808036:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788744278.808081:0:10422:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744278.808097:0:10422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10422:1875634154439936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744278.808120:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744278.808126:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744278.808920:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788744278.808929:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788744278.810857:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788744278.810888:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744278.810898:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.810910:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744278.811469:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744278.811473:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75196e800 from 4 10000000:01000000:1.0:1788744278.811476:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744278.811510:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.811519:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.811528:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744278.811560:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154440064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.811618:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.811670:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744278.814066:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440064 00000100:00100000:3.0:1788744278.814080:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440064 00000100:00100000:3.0:1788744278.814137:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788744278.814149:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154440064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744278.814166:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744278.814194:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.814221:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.814233:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.814242:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac76061b600, rc 0) 00000100:00100000:3.0:1788744278.814325:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154440064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744278.814341:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788744278.814394:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154440064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744278.814443:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744278.814452:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744278.814530:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154440192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.814562:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744278.814589:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744278.814600:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440192 00000100:00100000:3.0:1788744278.814604:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440192 00000100:00100000:3.0:1788744278.814624:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788744278.814630:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154440192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.814742:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154440192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744278.814749:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788744278.814776:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154440192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.814801:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154440320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.814832:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744278.814848:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a48cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744278.814858:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440320 00000100:00100000:3.0:1788744278.814861:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440320 00000100:00100000:3.0:1788744278.814880:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788744278.814891:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154440320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744278.814970:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154440320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744278.814977:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788744278.815011:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154440320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744278.818135:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10425:1875634154440448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.818215:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.818250:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440448 00000100:00100000:1.0:1788744278.818266:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440448 00000100:00100000:1.0:1788744278.818302:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788744278.818310:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:10425:x1875634154440448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.818423:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:10425:x1875634154440448:12345-0@lo:502:llog_process_th.0 Request processed in 112us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.818430:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788744278.818637:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643551b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744278.818668:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10425:1875634154440448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744278.818710:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744278.818720:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744278.818722:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788744278.818729:0:10425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac75196e800 00000020:00000080:1.0:1788744278.818732:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788744278.819913:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10425:1875634154440576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.821985:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.822023:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440576 00000100:00100000:1.0:1788744278.822031:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440576 00000100:00100000:1.0:1788744278.822072:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788744278.822081:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:10425:x1875634154440576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744278.822199:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:10425:x1875634154440576:12345-0@lo:502:llog_process_th.0 Request processed in 119us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.822208:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788744278.831814:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac748b1dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744278.832209:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:10425:1875634154440576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744278.832248:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744278.832255:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744278.832258:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788744278.832262:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788744278.832768:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788744278.832792:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744278.832802:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744278.832814:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744278.894889:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154440704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744278.894960:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744278.895247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440704 00000100:00100000:1.0:1788744278.895255:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440704 00000100:00100000:1.0:1788744278.895310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744278.895319:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154440704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744278.895352:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744278.895429:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154440704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744278.895436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744278.895524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154440704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744279.055759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744279.055798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744279.055835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744279.055842:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651520 00000100:00100000:2.0:1788744279.055856:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651520 00000100:00100000:1.0:1788744279.055857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744279.055953:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788744279.055957:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744279.055966:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138651520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744279.055983:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651136 00000100:00100000:1.0:1788744279.055987:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651136 00000100:00100000:1.0:1788744279.056016:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:1.0:1788744279.056035:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:2395:x1875634138651136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744279.056062:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138651520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.056062:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:2395:x1875634138651136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744279.056071:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788744279.056071:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:2.0:1788744279.056087:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651648 00000100:00100000:2.0:1788744279.056091:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651648 00000100:00100000:1.0:1788744279.056106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651264 00000100:00100000:1.0:1788744279.056110:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651264 00000100:00100000:2.0:1788744279.056128:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788744279.056134:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138651648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744279.056138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651392 00000100:00100000:1.0:1788744279.056141:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651392 00000100:00100000:2.0:1788744279.056160:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138651648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.056164:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1788744279.056170:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138651264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744279.056172:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00080000:2.0:1788744279.056189:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744279.056193:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744279.056196:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744279.056197:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138651264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (450us total) trans 0 rc 0/0 00000100:00080000:2.0:1788744279.056198:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744279.056204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1788744279.056214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1788744279.056220:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138651392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744279.056241:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138651392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.056247:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1788744279.371553:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744279.371725:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651776 00000100:00100000:3.0:1788744279.371741:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651776 00000100:00100000:3.0:1788744279.371808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:3.0:1788744279.371821:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:6165:x1875634138651776:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744279.371844:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744279.371867:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744279.371905:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744279.371919:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744279.371929:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be000, rc 0) 00000100:00100000:3.0:1788744279.372009:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138651776:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 189us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744279.372017:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:0.0:1788744279.386913:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744279.387010:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138651904 00000100:00100000:2.0:1788744279.387025:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138651904 00000100:00100000:2.0:1788744279.387096:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 271 00000100:00100000:2.0:1788744279.387110:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138651904:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744279.387323:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138651904:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 215us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744279.387333:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 271 00000100:00100000:0.0:1788744279.406755:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744279.407241:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652032 00000100:00100000:1.0:1788744279.407254:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652032 00000100:00100000:1.0:1788744279.407474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 272 00000100:00100000:1.0:1788744279.407488:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138652032:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744279.407678:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6165:x1875634138652032:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 193us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.407707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 272 00010000:00010000:3.0:1788744279.410067:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744279.412266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744279.412932:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652160 00000100:00100000:3.0:1788744279.412949:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652160 00000100:00100000:3.0:1788744279.413055:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 273 00000100:00100000:3.0:1788744279.413084:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6722:x1875634138652160:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744279.417873:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6722:x1875634138652160:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 4776us (5604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744279.417888:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 273 00000100:00100000:0.0:1788744279.429454:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744279.429722:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652288 00000100:00100000:3.0:1788744279.429738:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652288 00000100:00100000:3.0:1788744279.429803:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:3.0:1788744279.429815:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6722:x1875634138652288:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744279.429987:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:6722:x1875634138652288:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 174us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744279.429995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:0.0:1788744279.920585:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154440832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744279.920741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744279.920846:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440832 00000100:00100000:0.0:1788744279.920857:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440832 00000100:00100000:0.0:1788744279.920919:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788744279.920932:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154440832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744279.920979:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744279.921130:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154440832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744279.921139:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744279.921177:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154440832:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744280.435341:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744281.454927:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154440960:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455029:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455101:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154441472:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455132:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455151:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154441984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455192:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154442496:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455211:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455236:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788744281.455242:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154441344:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154441856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455342:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154442368:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455391:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154441216:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455437:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455457:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154441728:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455478:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455495:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154442240:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455537:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788744281.455543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455564:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455580:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154441600:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455600:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455611:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154442112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.455629:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.455653:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441984 00000100:00100000:2.0:1788744281.455661:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441984 00000100:00100000:2.0:1788744281.455727:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442496 00000100:00100000:2.0:1788744281.455730:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442496 00000100:00100000:2.0:1788744281.455746:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441856 00010000:00010000:1.0:1788744281.455747:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744281.455749:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441856 00000100:00100000:2.0:1788744281.455760:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442368 00000100:00100000:2.0:1788744281.455762:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442368 00000100:00100000:2.0:1788744281.455778:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744281.455788:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154441984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.455788:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744281.455797:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154442496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.455849:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154442496:12345-0@lo:400:kworker.0 Request processed in 54us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744281.455856:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744281.455879:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744281.455886:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154441856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744281.455903:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441472 00000100:00100000:3.0:1788744281.455909:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441472 00000100:00100000:2.0:1788744281.455913:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154441984:12345-0@lo:400:kworker.0 Request processed in 124us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744281.455932:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744281.455943:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441216 00000100:00100000:3.0:1788744281.455947:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441216 00000100:00100000:3.0:1788744281.455965:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744281.455973:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744281.455978:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154440960 00000100:00100000:0.0:1788744281.455985:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154440960 00000100:00100000:3.0:1788744281.456022:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154441472:12345-0@lo:400:kworker.0 Request processed in 50us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744281.456028:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744281.456042:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744281.456047:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154441216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.456168:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154441856:12345-0@lo:400:kworker.0 Request processed in 282us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744281.456178:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788744281.456188:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154440960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744281.456215:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154441216:12345-0@lo:400:kworker.0 Request processed in 165us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744281.456225:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744281.456230:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744281.456245:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154440960:12345-0@lo:400:kworker.0 Request processed in 58us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744281.456246:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744281.456258:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788744281.456261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441344 00000100:00100000:2.0:1788744281.456262:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154442368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744281.456267:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441344 00000100:00100000:1.0:1788744281.456275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441728 00000100:00100000:1.0:1788744281.456280:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441728 00000100:00100000:3.0:1788744281.456295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442240 00000100:00100000:3.0:1788744281.456299:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442240 00000100:00100000:2.0:1788744281.456306:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154442368:12345-0@lo:400:kworker.0 Request processed in 51us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744281.456307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441088 00000100:00100000:1.0:1788744281.456311:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441088 00000100:00100000:2.0:1788744281.456313:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744281.456324:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154441600 00000100:00100000:3.0:1788744281.456328:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154441600 00000100:00100000:1.0:1788744281.456334:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442112 00000100:00100000:1.0:1788744281.456339:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442112 00000100:00100000:2.0:1788744281.456346:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744281.456353:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744281.456356:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154441344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744281.456365:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154441728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.456366:0:6515:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788744281.456508:0:6515:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:0.0:1788744281.458528:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdca680 x1875634154441856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744281.458549:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154441856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.459023:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154441344:12345-0@lo:400:kworker.0 Request processed in 2667us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744281.461498:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744281.461581:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744281.461604:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154442240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.461726:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154442240:12345-0@lo:400:kworker.0 Request processed in 134us (6207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744281.461732:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744281.461742:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744281.461748:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154441088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.461772:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154441088:12345-0@lo:400:kworker.0 Request processed in 26us (6209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744281.461776:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744281.461787:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744281.461792:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154441600:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788744281.461849:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc9f80 x1875634154442368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744281.461857:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154441216:0@lo:400:kworker.0 00000100:00100000:2.0:1788744281.461866:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154441600:12345-0@lo:400:kworker.0 Request processed in 68us (6259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744281.461867:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154441728:12345-0@lo:400:kworker.0 Request processed in 5498us (6380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744281.461877:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154442368:0@lo:400:kworker.0 00000100:00100000:3.0:1788744281.461895:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744281.461902:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744281.461918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154440960:0@lo:400:kworker.0 00010000:00080000:1.0:1788744281.461919:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8e00 x1875634154441728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744281.461922:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788744281.461944:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.461947:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154441728:0@lo:400:kworker.0 00000100:00100000:0.0:1788744281.461951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154441472:0@lo:400:kworker.0 00000100:00080000:2.0:1788744281.461965:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744281.461974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788744281.461981:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8000 x1875634154441984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744281.461985:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744281.461990:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154442112:12345-0@lo:400:kworker.0 Request processed in 47us (6353us total) trans 0 rc 0/0 00000100:00080000:2.0:1788744281.461995:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744281.462008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788744281.462023:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdcb480 x1875634154442240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744281.462036:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154442240:0@lo:400:kworker.0 00000100:00100000:0.0:1788744281.462070:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154441984:0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.462076:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154441088:0@lo:400:kworker.0 00010000:00080000:0.0:1788744281.462102:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8700 x1875634154442496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744281.462116:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154441600:0@lo:400:kworker.0 00000100:00100000:0.0:1788744281.462132:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154442496:0@lo:400:kworker.0 00000100:00100000:1.0:1788744281.462146:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154442112:0@lo:400:kworker.0 00000100:00100000:0.0:1788744281.462204:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154441344:0@lo:400:kworker.0 00000100:00100000:3.0:1788744281.971428:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154442624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744281.971497:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744281.971610:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442624 00000100:00100000:2.0:1788744281.971619:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442624 00000100:00100000:2.0:1788744281.971675:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744281.971693:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154442624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744281.971728:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744281.971773:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154442624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744281.971780:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788744281.971950:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64365ca80 x1875634154442624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744281.971967:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154442624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744281.973085:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744281.973101:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154442752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744281.973152:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744281.973229:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442752 00000100:00100000:3.0:1788744281.973236:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442752 00000100:00100000:3.0:1788744281.973285:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744281.973294:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154442752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744281.973314:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744281.973525:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154442752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744281.973547:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788744281.977389:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437c8000 x1875634154442752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744281.977441:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154442752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744282.479704:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154442880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744282.479774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744282.479849:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154442880 00000100:00100000:1.0:1788744282.479857:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154442880 00000100:00100000:1.0:1788744282.479901:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744282.479908:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154442880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744282.479939:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744282.479982:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154442880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744282.479989:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788744282.480028:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437c8000 x1875634154442880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744282.480049:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154442880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788744282.480867:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744282.996718:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154443008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744282.996779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744282.997159:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443008 00000100:00100000:3.0:1788744282.997167:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443008 00000100:00100000:3.0:1788744282.997216:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744282.997226:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154443008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744282.997248:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744283.004265:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154443008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7032us (7475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744283.004279:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788744283.015532:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8700 x1875634154443008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744283.015559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154443008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744283.526820:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744284.017637:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154443136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744284.017713:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.022144:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443136 00000100:00100000:3.0:1788744284.022158:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443136 00000100:00100000:3.0:1788744284.022205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744284.022214:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154443136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744284.022248:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744284.022328:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154443136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.022335:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744284.022390:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154443136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744284.177556:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744284.177597:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744284.177625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744284.177657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744284.177699:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744284.177726:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652672 00000100:00100000:2.0:1788744284.177742:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652672 00000100:00100000:2.0:1788744284.177793:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652544 00000100:00100000:2.0:1788744284.177797:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652544 00000100:00100000:2.0:1788744284.177818:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1788744284.177828:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138652672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744284.177894:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138652672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 68us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744284.177901:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1788744284.177917:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1788744284.177922:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138652544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744284.177943:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138652544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744284.177949:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00080000:2.0:1788744284.177966:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744284.177969:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744284.178095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652416 00000100:00100000:1.0:1788744284.178100:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652416 00000100:00100000:1.0:1788744284.178136:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:1.0:1788744284.178143:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138652416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744284.178176:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138652416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.178182:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:1.0:1788744284.178208:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652928 00000100:00100000:1.0:1788744284.178212:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652928 00000100:00100000:1.0:1788744284.178238:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138652800 00000100:00100000:1.0:1788744284.178241:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138652800 00000100:00100000:1.0:1788744284.178260:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788744284.178266:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138652928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744284.178292:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138652928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.178298:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788744284.178309:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788744284.178314:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138652800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744284.178334:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138652800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.178340:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00080000:1.0:1788744284.178428:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744284.178432:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788744284.532475:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744285.054517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154443264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744285.054594:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744285.054790:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443264 00000100:00100000:0.0:1788744285.054799:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443264 00000100:00100000:0.0:1788744285.054846:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744285.054854:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154443264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744285.054889:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744285.054938:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154443264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744285.054945:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744285.055875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154443264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744285.551688:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744285.719943:0:10692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788744286.575194:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744286.575621:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154443648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.575732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744286.575798:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154444160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.575824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744286.575847:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154444672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.575897:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744286.575929:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744286.575945:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154443776:0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.575969:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744286.575987:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154444288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.576010:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744286.576026:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154444800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.576045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744286.576082:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444160 00000100:00100000:2.0:1788744286.576092:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444160 00000100:00100000:1.0:1788744286.576589:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154443392:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.576655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744286.576725:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154443520:0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.576756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744286.581827:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444672 00000100:00100000:3.0:1788744286.581844:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444672 00000100:00100000:3.0:1788744286.581903:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443776 00000100:00100000:3.0:1788744286.581907:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443776 00000100:00100000:3.0:1788744286.581920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443520 00000100:00100000:3.0:1788744286.581923:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443520 00000100:00100000:3.0:1788744286.581945:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744286.581956:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154444160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744286.582098:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154444160:12345-0@lo:400:kworker.0 Request processed in 143us (6272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744286.582107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744286.582127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744286.582133:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154444672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744286.582163:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154444672:12345-0@lo:400:kworker.0 Request processed in 31us (6267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744286.582168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744286.582181:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788744286.582186:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154443776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744286.582952:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154443776:12345-0@lo:400:kworker.0 Request processed in 761us (6977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744286.582961:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788744286.582981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788744286.582991:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744286.583037:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154443520:12345-0@lo:400:kworker.0 Request processed in 50us (6280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744286.583043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788744286.588023:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154443904:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.588127:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744286.588178:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154444416:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.588217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744286.588254:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154444928:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.588275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744286.588353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443648 00000100:00100000:1.0:1788744286.588362:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443648 00000100:00100000:1.0:1788744286.588438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443904 00000100:00100000:1.0:1788744286.588442:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443904 00000100:00100000:1.0:1788744286.588477:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744286.588488:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154443648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.588553:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154443648:12345-0@lo:400:kworker.0 Request processed in 66us (12821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744286.588560:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744286.588579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744286.588585:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154443904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.588617:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154443904:12345-0@lo:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744286.588624:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744286.589396:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444288 00000100:00100000:1.0:1788744286.589434:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444288 00000100:00100000:1.0:1788744286.591445:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444800 00000100:00100000:1.0:1788744286.592353:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444800 00000100:00100000:0.0:1788744286.592934:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154443520:0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.592950:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154444032:0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.593025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744286.593072:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154444544:0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.593095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744286.593150:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444032 00000100:00100000:0.0:1788744286.593155:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444032 00000100:00100000:0.0:1788744286.593196:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444544 00000100:00100000:0.0:1788744286.593198:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444544 00000100:00100000:0.0:1788744286.593227:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744286.593329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744286.593340:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154444544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744286.593418:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154444544:12345-0@lo:400:kworker.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744286.593426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788744286.593612:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444416 00000100:00100000:1.0:1788744286.593617:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444416 00000100:00100000:0.0:1788744286.593952:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154444032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.593996:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154444032:12345-0@lo:400:kworker.0 Request processed in 759us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744286.594003:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744286.594048:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154444032:0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.594059:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154444544:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.594118:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154444928 00000100:00100000:1.0:1788744286.594123:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154444928 00000100:00100000:1.0:1788744286.594144:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744286.594153:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.594230:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154444288:12345-0@lo:400:kworker.0 Request processed in 79us (18218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744286.600054:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744286.600119:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744286.600141:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154444800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.600282:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154444800:12345-0@lo:400:kworker.0 Request processed in 154us (24235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744286.600288:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744286.600301:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744286.600308:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154444416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.600339:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154444416:12345-0@lo:400:kworker.0 Request processed in 32us (12131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744286.600345:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744286.601069:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154443392 00000100:00100000:0.0:1788744286.601084:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154443392 00000100:00100000:0.0:1788744286.601149:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788744286.601159:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154443392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.601223:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154443392:12345-0@lo:400:kworker.0 Request processed in 66us (24575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744286.601229:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1788744286.601279:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744286.601286:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744286.601290:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744286.601293:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744286.601308:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744286.601318:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744286.601353:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154444928:12345-0@lo:400:kworker.0 Request processed in 37us (13076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744286.601358:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744286.608773:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154443776:0@lo:400:kworker.0 00010000:00080000:3.0:1788744286.608801:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce7480 x1875634154444288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744286.608812:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154444288:0@lo:400:kworker.0 00010000:00080000:3.0:1788744286.608826:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce4380 x1875634154444800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744286.608854:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154444800:0@lo:400:kworker.0 00000100:00100000:3.0:1788744286.608872:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154443648:0@lo:400:kworker.0 00010000:00080000:3.0:1788744286.608884:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce7100 x1875634154444160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744286.608892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154444160:0@lo:400:kworker.0 00010000:00080000:3.0:1788744286.608905:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce4700 x1875634154444672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744286.608913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154444672:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.609711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154443392:0@lo:400:kworker.0 00000100:00100000:1.0:1788744286.609952:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154443904:0@lo:400:kworker.0 00010000:00080000:1.0:1788744286.609969:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce7800 x1875634154444416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744286.609979:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154444416:0@lo:400:kworker.0 00010000:00080000:1.0:1788744286.609991:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce5180 x1875634154444928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744286.610008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154444928:0@lo:400:kworker.0 00000100:00100000:1.0:1788744287.089886:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744287.089915:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154445056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744287.090003:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744287.090076:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445056 00000100:00100000:1.0:1788744287.090086:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445056 00000100:00100000:1.0:1788744287.090146:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744287.090156:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154445056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744287.090194:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744287.090245:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154445056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744287.090253:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788744287.090302:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c98700 x1875634154445056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744287.090323:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154445056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744287.093076:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154445184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744287.093196:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744287.094783:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445184 00000100:00100000:1.0:1788744287.094800:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445184 00000100:00100000:1.0:1788744287.094860:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788744287.094872:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154445184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744287.094903:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744287.094987:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154445184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744287.094995:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788744287.095044:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc4000 x1875634154445184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744287.095083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154445184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788744287.599007:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744287.603154:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154445312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744287.603249:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744287.603381:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445312 00000100:00100000:3.0:1788744287.603391:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445312 00000100:00100000:3.0:1788744287.603473:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744287.603486:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154445312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744287.603523:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744287.603578:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154445312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744287.603586:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788744287.603683:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc4000 x1875634154445312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744287.603706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154445312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744288.111975:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744288.112012:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744288.112105:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744288.112378:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445440 00000100:00100000:3.0:1788744288.112388:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445440 00000100:00100000:3.0:1788744288.112648:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744288.112662:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154445440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744288.112691:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744288.112755:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154445440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744288.112782:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788744288.112847:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8000 x1875634154445440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744288.112870:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154445440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744288.112922:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744288.623752:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744289.134976:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154445568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744289.135067:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744289.135178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445568 00000100:00100000:1.0:1788744289.135188:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445568 00000100:00100000:1.0:1788744289.135242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744289.135252:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154445568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744289.135293:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744289.135339:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154445568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744289.135346:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744289.135398:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154445568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744289.294728:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744289.296234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744289.296515:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744289.307755:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653056 00000100:00100000:0.0:1788744289.307777:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653056 00000100:00100000:0.0:1788744289.307863:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 278 00000100:00100000:0.0:1788744289.307887:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138653056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744289.307987:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138653056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 113us (13355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744289.307995:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 278 00000100:00100000:3.0:1788744289.318818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653312 00000100:00100000:3.0:1788744289.318849:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653312 00000100:00100000:3.0:1788744289.318943:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653184 00000100:00100000:3.0:1788744289.318947:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653184 00000100:00100000:3.0:1788744289.318979:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1788744289.318991:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138653312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744289.319112:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138653312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 112us (22875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744289.319121:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1788744289.319142:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1788744289.319150:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138653184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744289.319178:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138653184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (22664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744289.319184:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00080000:3.0:1788744289.319214:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744289.319218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744289.319280:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744289.319430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744289.319484:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653440 00000100:00100000:3.0:1788744289.319489:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653440 00000100:00100000:3.0:1788744289.321578:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653568 00000100:00100000:3.0:1788744289.321594:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653568 00000100:00100000:3.0:1788744289.321659:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1788744289.321671:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2393:x1875634138653440:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:3.0:1788744289.321729:0:8966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc17c 00000100:00080000:3.0:1788744289.321742:0:8966:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744289.321795:0:8966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788744289.322014:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+2:2393:x1875634138653440:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 344us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744289.322023:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1788744289.322041:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788744289.322048:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2393:x1875634138653568:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:3.0:1788744289.322064:0:8966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc183 00000100:00080000:3.0:1788744289.322071:0:8966:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744289.322114:0:8966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788744289.322190:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+2:2393:x1875634138653568:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 142us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744289.322196:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:3.0:1788744289.322294:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744289.322303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744289.322307:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744289.322498:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744289.648646:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744290.158611:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744290.158642:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154445696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744290.158710:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744290.158786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445696 00000100:00100000:0.0:1788744290.158794:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445696 00000100:00100000:0.0:1788744290.158835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788744290.158843:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154445696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744290.158877:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744290.158917:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154445696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744290.158924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788744290.159181:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154445696:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744290.678533:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744291.694977:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744291.695263:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154445824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.695321:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154446208:0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695343:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.695355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.695396:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154446080:0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695423:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154446336:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.695455:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744291.695457:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744291.695471:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445824 00000100:00100000:0.0:1788744291.695479:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445824 00000100:00100000:1.0:1788744291.695507:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154446720:0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695534:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788744291.695540:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744291.695548:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.695568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154447232:0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695605:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154445824:12345-0@lo:400:kworker.0 Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744291.695627:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788744291.695640:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154446592:0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695663:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446208 00000100:00100000:0.0:1788744291.695668:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446208 00000100:00100000:3.0:1788744291.695669:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.695699:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154447104:0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695700:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446592 00000100:00100000:0.0:1788744291.695706:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446592 00000100:00100000:3.0:1788744291.695727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744291.695734:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744291.695751:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447104 00000100:00100000:0.0:1788744291.695757:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447104 00000100:00100000:3.0:1788744291.695768:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446080 00000100:00100000:3.0:1788744291.695774:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446080 00000100:00100000:0.0:1788744291.695782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744291.695791:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154446208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.695813:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788744291.695825:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744291.695827:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154446592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.695836:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154446080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.695840:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154446208:12345-0@lo:400:kworker.0 Request processed in 49us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744291.695854:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744291.695871:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788744291.695880:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154447104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.695888:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154446080:12345-0@lo:400:kworker.0 Request processed in 54us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744291.695897:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154446592:12345-0@lo:400:kworker.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.695901:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744291.695910:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788744291.695921:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154447104:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.695929:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446720 00000100:00100000:0.0:1788744291.695929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788744291.695935:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446720 00000100:00080000:1.0:1788744291.695959:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744291.695966:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744291.695967:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447232 00000100:00100000:3.0:1788744291.695971:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447232 00000100:00100000:0.0:1788744291.695983:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154446208:0@lo:400:kworker.0 00000100:00080000:1.0:1788744291.695993:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744291.696008:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744291.696015:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154446720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.696060:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154446720:12345-0@lo:400:kworker.0 Request processed in 45us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.696066:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744291.696078:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744291.696083:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154447232:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788744291.696227:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e014a80 x1875634154446720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744291.696238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154446720:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.696330:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154447232:12345-0@lo:400:kworker.0 Request processed in 246us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.696336:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744291.696369:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.696396:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154446464:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.696434:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.696449:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154446976:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.696475:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.696501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154445952 00000100:00100000:3.0:1788744291.696505:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154445952 00000100:00100000:3.0:1788744291.696524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446464 00000100:00100000:3.0:1788744291.696526:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446464 00000100:00100000:3.0:1788744291.696542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446976 00000100:00100000:3.0:1788744291.696544:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446976 00000100:00100000:3.0:1788744291.696556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788744291.696561:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.696590:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154445952:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.696595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788744291.696605:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788744291.696610:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154446464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.697095:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788744291.697106:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154446976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.697144:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154446976:12345-0@lo:400:kworker.0 Request processed in 42us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744291.697150:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788744291.697192:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154446464:12345-0@lo:400:kworker.0 Request processed in 581us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.697199:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788744291.697222:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744291.697247:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.697260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154446464:0@lo:400:kworker.0 00010000:00080000:0.0:1788744291.697448:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64372bb80 x1875634154447232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744291.697465:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154447232:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.698722:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154446976:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.698760:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.698803:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154446848:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.698841:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.698873:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154447360:0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.698887:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446848 00000100:00100000:1.0:1788744291.698895:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446848 00000100:00100000:3.0:1788744291.698908:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744291.698938:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154445824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.698947:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447360 00000100:00100000:1.0:1788744291.698952:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447360 00000100:00100000:3.0:1788744291.698971:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744291.698979:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744291.698984:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154446848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744291.698991:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154447360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.699044:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154446848:12345-0@lo:400:kworker.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744291.699047:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154447360:12345-0@lo:400:kworker.0 Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744291.699056:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744291.699300:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744291.700149:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154446336 00000100:00100000:0.0:1788744291.700158:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154446336 00000100:00100000:0.0:1788744291.700207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744291.700215:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154446336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744291.700761:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154446336:12345-0@lo:400:kworker.0 Request processed in 546us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744291.700768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788744291.700881:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744291.700887:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744291.700925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154446336:0@lo:400:kworker.0 00010000:00080000:3.0:1788744291.700947:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e014000 x1875634154446848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744291.700961:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154446848:0@lo:400:kworker.0 00010000:00080000:3.0:1788744291.700978:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64372ad80 x1875634154447360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744291.700988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154447360:0@lo:400:kworker.0 00000100:00100000:3.0:1788744291.701043:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154446080:0@lo:400:kworker.0 00010000:00080000:3.0:1788744291.701062:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e016d80 x1875634154446592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744291.701073:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154446592:0@lo:400:kworker.0 00010000:00080000:3.0:1788744291.701090:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643728e00 x1875634154447104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744291.701187:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154447104:0@lo:400:kworker.0 00000100:00100000:3.0:1788744292.207582:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154447488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744292.207651:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744292.207715:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447488 00000100:00100000:3.0:1788744292.207722:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447488 00000100:00100000:3.0:1788744292.207765:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744292.207773:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154447488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744292.207813:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744292.207856:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154447488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744292.207863:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788744292.207901:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643728e00 x1875634154447488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744292.207918:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154447488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744292.209906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154447616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744292.209966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744292.210045:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447616 00000100:00100000:2.0:1788744292.210052:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447616 00000100:00100000:2.0:1788744292.210095:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744292.210105:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154447616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744292.210125:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744292.210731:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154447616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 626us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744292.210739:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788744292.210903:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8700 x1875634154447616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744292.210922:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154447616:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788744292.397273:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing yml_node 00010000:00010000:1.0:1788744292.719499:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744292.720757:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744292.720781:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154447744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744292.720847:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744292.721262:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447744 00000100:00100000:3.0:1788744292.721271:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447744 00000100:00100000:3.0:1788744292.721327:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744292.721337:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154447744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744292.721366:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744292.722130:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154447744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 790us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744292.722147:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788744292.723216:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64372a680 x1875634154447744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744292.723241:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154447744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744293.231341:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744293.231364:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154447872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744293.231656:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744293.232253:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154447872 00000100:00100000:1.0:1788744293.232262:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154447872 00000100:00100000:1.0:1788744293.232328:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744293.232339:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154447872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744293.232369:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744293.232439:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154447872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744293.232446:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788744293.232955:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744293.232992:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c9a680 x1875634154447872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744293.233013:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154447872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744293.742830:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744294.254888:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744294.258240:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154448000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744294.258312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744294.258702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448000 00000100:00100000:0.0:1788744294.258711:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448000 00000100:00100000:0.0:1788744294.258763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744294.258773:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154448000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744294.258806:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744294.258860:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154448000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744294.258867:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744294.259045:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154448000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744294.416093:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744294.416141:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744294.416178:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653696 00000100:00100000:3.0:1788744294.416183:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744294.416192:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653696 00000100:00100000:0.0:1788744294.416247:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:0.0:1788744294.416258:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2396:x1875634138653696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744294.416313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653952 00000100:00100000:2.0:1788744294.416318:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653952 00000100:00100000:0.0:1788744294.416344:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2396:x1875634138653696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744294.416354:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:2.0:1788744294.416362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138653824 00000100:00100000:2.0:1788744294.416367:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138653824 00000100:00080000:0.0:1788744294.416445:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744294.416451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00080000:0.0:1788744294.416452:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744294.416463:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138653952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744294.416478:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:0.0:1788744294.416490:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2396:x1875634138653824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744294.416502:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138653952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744294.416509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1788744294.416527:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2396:x1875634138653824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744294.416535:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00010000:00010000:3.0:1788744294.766640:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744295.279379:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744295.279427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154448128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744295.279490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744295.279624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448128 00000100:00100000:1.0:1788744295.279632:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448128 00000100:00100000:1.0:1788744295.279686:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744295.279695:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154448128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744295.279726:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788744295.279776:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154448128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744295.279783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744295.280869:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154448128:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788744295.281349:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:3.0:1788744295.281355:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ac6433ce000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:0.0:1788744295.281467:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433ce000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-OST0000 00000020:00000080:0.0:1788744295.281513:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6433cb800 for lustre-OST0000 00000001:00100000:1.0:1788744295.281980:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:1.0:1788744295.281985:0:9507:0:(genops.c:885:class_export_put()) final put ffff9ac6433cc800/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:3.0:1788744295.282154:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433cc800/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-OST0001 00000020:00000080:3.0:1788744295.282203:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6433cd000 for lustre-OST0001 00010000:00010000:1.0:1788744295.794362:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744296.811628:0:11119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.44 00000100:00100000:3.0:1788744296.814663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154448640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.814663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154448384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.814820:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154448256:0@lo:400:kworker.0 00010000:00010000:0.0:1788744296.820704:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744296.822479:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744296.822607:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154448896:0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.822653:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744296.822694:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448384 00000100:00100000:1.0:1788744296.822702:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448384 00000100:00100000:1.0:1788744296.822761:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448896 00000100:00100000:1.0:1788744296.822765:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448896 00000100:00100000:1.0:1788744296.822802:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744296.822811:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154448384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.822870:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154448384:12345-0@lo:400:kworker.0 Request processed in 60us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.822888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744296.822909:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788744296.822918:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154448896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.822962:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154448896:12345-0@lo:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.822969:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788744296.822991:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744296.823093:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154448896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.823108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154449408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.823161:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744296.823229:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154448384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.823249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449408 00000100:00100000:1.0:1788744296.823257:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449408 00000100:00080000:0.0:1788744296.823297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744296.823306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788744296.823315:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154449408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.823448:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154449408:12345-0@lo:400:kworker.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.823455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788744296.823625:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154449408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.824513:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154448512:0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.824570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744296.824609:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154449024:0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.824637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744296.824671:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154449536:0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.824695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744296.826513:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448512 00000100:00100000:1.0:1788744296.826527:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448512 00000100:00100000:1.0:1788744296.826600:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788744296.826610:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154448512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.826702:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154448512:12345-0@lo:400:kworker.0 Request processed in 94us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.826710:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788744296.826735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449024 00000100:00100000:1.0:1788744296.826739:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449024 00000100:00100000:1.0:1788744296.826769:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449536 00000100:00100000:1.0:1788744296.826773:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449536 00000100:00100000:1.0:1788744296.826793:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788744296.826799:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154449024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.826846:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154449024:12345-0@lo:400:kworker.0 Request processed in 48us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.826853:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788744296.826864:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744296.826871:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154449536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.826898:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154449536:12345-0@lo:400:kworker.0 Request processed in 28us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.826903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744296.826947:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154448512:0@lo:400:kworker.0 00010000:00080000:1.0:1788744296.826963:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437c8a80 x1875634154449024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744296.826974:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154449024:0@lo:400:kworker.0 00010000:00080000:1.0:1788744296.826984:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337f800 x1875634154449536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744296.826992:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154449536:0@lo:400:kworker.0 00000100:00080000:1.0:1788744296.827018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744296.832150:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744296.832212:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154448768:0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.832224:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448256 00000100:00100000:1.0:1788744296.832232:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448256 00000100:00100000:2.0:1788744296.832253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744296.832280:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788744296.832284:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154449280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.832288:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154448256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.832307:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744296.832330:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449280 00000100:00100000:2.0:1788744296.832334:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449280 00000100:00100000:1.0:1788744296.832336:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154448256:12345-0@lo:400:kworker.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.832342:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788744296.832369:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744296.832375:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154449280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.832427:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154449280:12345-0@lo:400:kworker.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744296.832433:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788744296.832450:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744296.832477:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337df80 x1875634154449280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744296.832491:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154449280:0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.832498:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154449792:0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.832547:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744296.832580:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449792 00000100:00100000:1.0:1788744296.832599:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449792 00000100:00100000:2.0:1788744296.832601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154448256:0@lo:400:kworker.0 00000100:00080000:2.0:1788744296.832618:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744296.832632:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744296.832638:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154449792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.832683:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154449792:12345-0@lo:400:kworker.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.832690:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788744296.832754:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337ce00 x1875634154449792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744296.832764:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154449792:0@lo:400:kworker.0 00000100:00100000:3.0:1788744296.832782:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744296.832820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448640 00000100:00100000:1.0:1788744296.832825:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448640 00000100:00100000:1.0:1788744296.832857:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788744296.832863:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154448640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744296.832894:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154448640:12345-0@lo:400:kworker.0 Request processed in 31us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744296.832900:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788744296.833284:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154448640:0@lo:400:kworker.0 00000100:00100000:3.0:1788744296.833293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154449152:0@lo:400:kworker.0 00000100:00100000:3.0:1788744296.833318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744296.833335:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154449664:0@lo:400:kworker.0 00000100:00100000:3.0:1788744296.833355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744296.833474:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449152 00000100:00100000:2.0:1788744296.833479:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449152 00000100:00100000:2.0:1788744296.833507:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449664 00000100:00100000:2.0:1788744296.833512:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449664 00000100:00100000:2.0:1788744296.833530:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744296.833536:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154449152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.833570:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154449152:12345-0@lo:400:kworker.0 Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744296.833576:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744296.833599:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744296.833605:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154449664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744296.833631:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154449664:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744296.833636:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788744296.833652:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744296.833654:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744296.836770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154448768 00000100:00100000:0.0:1788744296.836782:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154448768 00000100:00100000:0.0:1788744296.836838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744296.836847:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154448768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744296.836941:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154448768:12345-0@lo:400:kworker.0 Request processed in 95us (4686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744296.836948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744296.837046:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154448768:0@lo:400:kworker.0 00010000:00080000:3.0:1788744296.837334:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad5500 x1875634154449152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744296.837346:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154449152:0@lo:400:kworker.0 00010000:00080000:3.0:1788744296.837369:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337c700 x1875634154449664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744296.837378:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154449664:0@lo:400:kworker.0 00000100:00100000:2.0:1788744297.327868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744297.327890:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744297.327947:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744297.328011:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154449920 00000100:00100000:2.0:1788744297.328019:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154449920 00000100:00100000:2.0:1788744297.328064:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744297.328073:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154449920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744297.328101:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744297.328144:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154449920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744297.328151:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788744297.328188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c99880 x1875634154449920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744297.328204:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744297.328311:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154450048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744297.328336:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744297.328426:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450048 00000100:00100000:0.0:1788744297.328431:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450048 00000100:00100000:0.0:1788744297.328457:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744297.328464:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154450048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744297.328475:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744297.328507:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154450048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744297.328514:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788744297.328616:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8700 x1875634154450048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744297.328629:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154450048:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788744297.838785:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744297.839003:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744297.839026:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154450176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744297.839095:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744297.839236:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450176 00000100:00100000:3.0:1788744297.839244:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450176 00000100:00100000:3.0:1788744297.839292:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744297.839302:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154450176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744297.839329:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744297.839390:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154450176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744297.839397:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788744297.839493:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64372a680 x1875634154450176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744297.839511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154450176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744298.351102:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154450304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744298.351173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744298.351308:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450304 00000100:00100000:1.0:1788744298.351317:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450304 00000100:00100000:1.0:1788744298.351382:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744298.351393:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154450304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744298.351452:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744298.351499:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154450304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744298.351506:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788744298.351546:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c9ad80 x1875634154450304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744298.351596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154450304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744298.352031:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744298.863550:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744299.057529:0:11217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.44 00000100:00100000:1.0:1788744299.374686:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744299.374713:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154450432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744299.374801:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744299.375479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450432 00000100:00100000:1.0:1788744299.375489:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450432 00000100:00100000:1.0:1788744299.375554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788744299.375576:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154450432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744299.375616:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744299.375683:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154450432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744299.375691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788744299.375754:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154450432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744299.533079:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744299.533118:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744299.533155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744299.533184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654208 00000100:00100000:0.0:1788744299.533193:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654208 00000100:00100000:0.0:1788744299.533244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654336 00000100:00100000:0.0:1788744299.533247:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654336 00000100:00100000:3.0:1788744299.533261:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:3.0:1788744299.533272:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138654208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744299.533305:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654080 00000100:00100000:2.0:1788744299.533309:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654080 00000100:00100000:3.0:1788744299.533344:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138654208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744299.538263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:0.0:1788744299.538300:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138654336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744299.538725:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138654336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 433us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744299.538734:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00080000:0.0:1788744299.538766:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744299.538770:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744299.539514:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 282 00000100:00100000:2.0:1788744299.539530:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138654080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744299.539579:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138654080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (6519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744299.540141:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 282 00000100:00100000:3.0:1788744299.543349:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00010000:00010000:2.0:1788744299.897348:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744300.399652:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154450560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744300.399720:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744300.399791:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450560 00000100:00100000:0.0:1788744300.399799:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450560 00000100:00100000:0.0:1788744300.399839:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788744300.399848:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154450560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744300.399882:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744300.399942:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154450560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744300.399949:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744300.399994:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154450560:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744300.910767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744301.788889:0:11314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.44 00010000:00010000:2.0:1788744301.936606:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744301.943727:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154450688:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.943801:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.943864:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450688 00000100:00100000:1.0:1788744301.943871:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450688 00000100:00100000:1.0:1788744301.943910:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788744301.943919:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154450688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.943966:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154450688:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744301.943973:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788744301.944014:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154450688:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944052:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154450816:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944093:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.944132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744301.944138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154450944:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944161:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.944192:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744301.944198:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154451072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944217:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.944239:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450816 00000100:00100000:1.0:1788744301.944243:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450816 00000100:00100000:1.0:1788744301.944267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451072 00000100:00100000:1.0:1788744301.944270:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451072 00000100:00100000:1.0:1788744301.944288:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788744301.944294:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154450816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944327:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154450816:12345-0@lo:400:kworker.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744301.944333:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788744301.944345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788744301.944351:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154451072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944379:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154451072:12345-0@lo:400:kworker.0 Request processed in 28us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744301.944384:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788744301.944453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154450816:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154451072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944504:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154451200:0@lo:400:kworker.0 00000100:00100000:2.0:1788744301.944613:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154450944 00000100:00100000:2.0:1788744301.944617:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154450944 00000100:00100000:2.0:1788744301.944642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744301.944647:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154450944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744301.944682:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154450944:12345-0@lo:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744301.944688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744301.944711:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154450944:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.944921:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744301.944926:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154451584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944949:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.944979:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154451712:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.944996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.945031:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744301.945035:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154452096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.945053:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744301.945080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154452224:0@lo:400:kworker.0 00000100:00100000:1.0:1788744301.945097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744301.945888:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451584 00000100:00100000:3.0:1788744301.945895:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451584 00000100:00100000:3.0:1788744301.945931:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451712 00000100:00100000:3.0:1788744301.945934:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451712 00000100:00100000:3.0:1788744301.945945:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452096 00000100:00100000:3.0:1788744301.945947:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452096 00000100:00100000:3.0:1788744301.945956:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452224 00000100:00100000:3.0:1788744301.945959:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452224 00000100:00100000:3.0:1788744301.945970:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744301.945977:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154451584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946033:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154451584:12345-0@lo:400:kworker.0 Request processed in 57us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946052:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744301.946068:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744301.946073:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154451712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946101:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154451712:12345-0@lo:400:kworker.0 Request processed in 27us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946106:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744301.946117:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744301.946123:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154452096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946149:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154452096:12345-0@lo:400:kworker.0 Request processed in 27us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946154:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744301.946164:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744301.946170:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154452224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946196:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154452224:12345-0@lo:400:kworker.0 Request processed in 26us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946201:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788744301.946217:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744301.946222:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744301.946234:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154451456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946264:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744301.946285:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154451968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946303:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744301.946321:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788744301.946326:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154451328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946345:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744301.946382:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154451840:0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946419:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744301.946444:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451456 00000100:00100000:3.0:1788744301.946447:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451456 00000100:00100000:3.0:1788744301.946473:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451968 00000100:00100000:3.0:1788744301.946477:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451968 00000100:00100000:3.0:1788744301.946488:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451328 00000100:00100000:3.0:1788744301.946490:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451328 00000100:00100000:3.0:1788744301.946502:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451840 00000100:00100000:3.0:1788744301.946504:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451840 00000100:00100000:3.0:1788744301.946516:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744301.946522:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946568:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154451456:12345-0@lo:400:kworker.0 Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946574:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744301.946586:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744301.946592:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154451968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946618:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154451968:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946623:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744301.946634:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788744301.946640:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154451328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946663:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154451328:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946668:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788744301.946677:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744301.946682:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154451840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946711:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154451840:12345-0@lo:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.946717:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788744301.946732:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744301.946735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744301.946757:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154451328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.946765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154451840:0@lo:400:kworker.0 00010000:00080000:3.0:1788744301.946775:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b7bb80 x1875634154451456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744301.946785:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154451456:0@lo:400:kworker.0 00010000:00080000:3.0:1788744301.946793:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b3b80 x1875634154451968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744301.946801:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154451968:0@lo:400:kworker.0 00010000:00080000:1.0:1788744301.946973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b0700 x1875634154452224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744301.946983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154452224:0@lo:400:kworker.0 00010000:00080000:1.0:1788744301.946992:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b3800 x1875634154452096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744301.947000:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154452096:0@lo:400:kworker.0 00010000:00080000:1.0:1788744301.947009:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b0a80 x1875634154451712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744301.947017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154451712:0@lo:400:kworker.0 00010000:00080000:1.0:1788744301.947024:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b79c00 x1875634154451584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744301.947032:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744301.951211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154451200 00000100:00100000:2.0:1788744301.951227:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154451200 00000100:00100000:3.0:1788744301.956454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788744301.956469:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154451200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744301.956568:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154451200:12345-0@lo:400:kworker.0 Request processed in 102us (12042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.956574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744301.956727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154451200:0@lo:400:kworker.0 00000100:00100000:3.0:1788744302.449939:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744302.449965:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154452352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744302.450036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744302.450160:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452352 00000100:00100000:2.0:1788744302.450169:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452352 00000100:00100000:2.0:1788744302.450221:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744302.450231:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154452352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744302.450264:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744302.450311:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154452352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744302.450318:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788744302.450360:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c9ad80 x1875634154452352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744302.450377:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154452352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744302.450560:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154452480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744302.450586:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744302.450663:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452480 00000100:00100000:0.0:1788744302.450669:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452480 00000100:00100000:0.0:1788744302.450688:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744302.450695:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154452480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744302.450707:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744302.450747:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154452480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744302.450755:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788744302.450826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337f800 x1875634154452480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744302.450839:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154452480:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788744302.958750:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744302.962719:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154452608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744302.962795:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744302.962906:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452608 00000100:00100000:0.0:1788744302.962914:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452608 00000100:00100000:0.0:1788744302.962969:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744302.962992:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154452608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744302.963021:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744302.963074:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154452608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744302.963081:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788744302.963243:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337c000 x1875634154452608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744302.963260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154452608:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788744303.221345:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 21:25:02 EDT 2026 00000100:00100000:0.0:1788744303.470718:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744303.470742:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154452736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744303.470818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744303.471058:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452736 00000100:00100000:2.0:1788744303.471067:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452736 00000100:00100000:2.0:1788744303.471132:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744303.471142:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154452736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744303.471165:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744303.471218:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154452736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00080000:3.0:1788744303.471221:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744303.471225:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788744303.471288:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c98700 x1875634154452736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744303.471306:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154452736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744303.983682:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744304.496703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154452864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744304.496764:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744304.496829:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452864 00000100:00100000:2.0:1788744304.496837:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452864 00000100:00100000:2.0:1788744304.496890:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744304.496898:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154452864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744304.496930:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744304.496975:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154452864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744304.496983:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744304.497022:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154452864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744304.653705:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744304.653764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744304.653792:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654592 00000100:00100000:3.0:1788744304.653802:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654592 00000100:00100000:3.0:1788744304.653858:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:3.0:1788744304.653869:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2396:x1875634138654592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744304.653937:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2396:x1875634138654592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744304.653945:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00080000:3.0:1788744304.653968:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744304.653978:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654464 00000100:00100000:1.0:1788744304.653984:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654464 00000100:00100000:1.0:1788744304.654018:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:1.0:1788744304.654027:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2397:x1875634138654464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744304.654056:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2397:x1875634138654464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744304.654063:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:1.0:1788744304.654481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744304.654693:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654720 00000100:00100000:3.0:1788744304.654699:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654720 00000100:00100000:3.0:1788744304.654889:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:3.0:1788744304.654898:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138654720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744304.654943:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138654720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744304.654949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00080000:1.0:1788744304.655719:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788744305.008263:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744305.528561:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744305.528607:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154452992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744305.529153:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744305.529221:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154452992 00000100:00100000:1.0:1788744305.529228:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154452992 00000100:00100000:1.0:1788744305.529274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744305.529283:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154452992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744305.529929:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788744305.529990:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154452992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 707us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744305.529998:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744305.530047:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154452992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788744306.034260:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744307.054985:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154453504:0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.054986:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154453376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.055085:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154453248:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.055604:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154453120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.063705:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744307.063769:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154453888:0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.063850:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744307.063878:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154454400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.063901:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744307.063979:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453888 00000100:00100000:2.0:1788744307.063988:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453888 00000100:00100000:2.0:1788744307.064036:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454400 00000100:00100000:2.0:1788744307.064039:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454400 00000100:00100000:2.0:1788744307.064062:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744307.064070:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154453888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.064121:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154453888:12345-0@lo:400:kworker.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744307.064128:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744307.064144:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744307.064150:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154454400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.064179:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154454400:12345-0@lo:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744307.064184:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744307.064218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453376 00000100:00100000:2.0:1788744307.064221:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453376 00000100:00100000:2.0:1788744307.064250:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744307.064256:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154453376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.064318:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154453376:12345-0@lo:400:kworker.0 Request processed in 62us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744307.064332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744307.064371:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154453376:0@lo:400:kworker.0 00010000:00080000:2.0:1788744307.064384:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a7b80 x1875634154453888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744307.064394:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154453888:0@lo:400:kworker.0 00010000:00080000:2.0:1788744307.064425:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1c00 x1875634154454400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744307.064434:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154454400:0@lo:400:kworker.0 00000100:00080000:2.0:1788744307.064491:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744307.068032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744307.068090:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154453760:0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.068130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744307.068166:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154454272:0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.068188:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744307.068239:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453248 00000100:00100000:0.0:1788744307.068246:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453248 00000100:00100000:0.0:1788744307.068288:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453760 00000100:00100000:0.0:1788744307.068291:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453760 00000100:00100000:0.0:1788744307.068326:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454272 00000100:00100000:0.0:1788744307.068330:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454272 00000100:00100000:0.0:1788744307.068347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744307.068355:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154453248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.068993:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154453248:12345-0@lo:400:kworker.0 Request processed in 635us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744307.069001:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744307.069020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744307.069028:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154453760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.069087:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154453760:12345-0@lo:400:kworker.0 Request processed in 61us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744307.069094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744307.069107:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788744307.069113:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154454272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.069152:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154454272:12345-0@lo:400:kworker.0 Request processed in 39us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744307.069158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788744307.069183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788744307.069255:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744307.069283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154453248:0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.069294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154453760:0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.069303:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154454272:0@lo:400:kworker.0 00000100:00100000:3.0:1788744307.077732:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744307.077795:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788744307.077836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744307.077869:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154454528:0@lo:400:kworker.0 00000100:00100000:3.0:1788744307.077892:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744307.077984:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454016 00000100:00100000:3.0:1788744307.077993:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454016 00000100:00100000:3.0:1788744307.078043:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454528 00000100:00100000:3.0:1788744307.078047:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454528 00000100:00100000:3.0:1788744307.078205:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744307.078214:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154454016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744307.078268:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154454016:12345-0@lo:400:kworker.0 Request processed in 55us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744307.078275:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744307.078290:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744307.078296:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744307.078335:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154454528:12345-0@lo:400:kworker.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744307.078341:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744307.078396:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453504 00000100:00100000:0.0:1788744307.078429:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453504 00000100:00100000:0.0:1788744307.078459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788744307.078466:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154453504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744307.078499:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154453504:12345-0@lo:400:kworker.0 Request processed in 34us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744307.078504:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788744307.078536:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744307.078540:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744307.081778:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744307.081846:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154453632:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.081883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744307.081915:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453632 00000100:00100000:1.0:1788744307.081923:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453632 00000100:00100000:1.0:1788744307.081967:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744307.081977:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154453632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.082025:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154453632:12345-0@lo:400:kworker.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744307.082031:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744307.082072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154453632:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.082080:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154454144:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.082104:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744307.095242:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154454656:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.095308:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744307.104768:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454144 00000100:00100000:2.0:1788744307.104785:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454144 00000100:00100000:2.0:1788744307.104818:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154453120 00000100:00100000:2.0:1788744307.104821:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154453120 00000100:00100000:2.0:1788744307.104909:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788744307.104920:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154453120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.105007:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154453120:12345-0@lo:400:kworker.0 Request processed in 89us (23236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744307.105014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788744307.105238:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744307.105245:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154454144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.105283:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154454144:12345-0@lo:400:kworker.0 Request processed in 38us (23178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744307.105306:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744307.106303:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154453504:0@lo:400:kworker.0 00000100:00080000:3.0:1788744307.106454:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744307.106995:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a7100 x1875634154454016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744307.107008:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154454016:0@lo:400:kworker.0 00010000:00080000:2.0:1788744307.107026:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1f80 x1875634154454528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744307.107034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154454528:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.109346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154453120:0@lo:400:kworker.0 00010000:00080000:1.0:1788744307.109372:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f3800 x1875634154454144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744307.109424:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154454144:0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.113480:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454656 00000100:00100000:2.0:1788744307.113496:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454656 00000100:00100000:2.0:1788744307.113606:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744307.113617:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154454656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744307.113722:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154454656:12345-0@lo:400:kworker.0 Request processed in 107us (18413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744307.113729:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788744307.115649:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788744307.115748:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0000 x1875634154454656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744307.115766:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154454656:0@lo:400:kworker.0 00000100:00100000:1.0:1788744307.567720:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744307.567755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154454784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744307.567822:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744307.567885:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454784 00000100:00100000:1.0:1788744307.567893:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454784 00000100:00100000:1.0:1788744307.567936:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744307.567946:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154454784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744307.567975:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744307.568018:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154454784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744307.568025:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788744307.568066:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c46680 x1875634154454784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744307.568096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154454784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744307.568437:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744307.568449:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154454912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744307.568481:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744307.568627:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154454912 00000100:00100000:3.0:1788744307.568634:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154454912 00000100:00100000:3.0:1788744307.568658:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744307.568666:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154454912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788744307.568679:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744307.568716:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154454912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744307.568722:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788744307.568761:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1c00 x1875634154454912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744307.568775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154454912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744308.078903:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154455040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744308.078969:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744308.079087:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744308.079263:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455040 00000100:00100000:0.0:1788744308.079272:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455040 00000100:00100000:0.0:1788744308.079322:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744308.079331:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154455040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744308.079377:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744308.079450:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154455040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744308.079458:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788744308.079543:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437c8700 x1875634154455040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744308.079570:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154455040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744308.596679:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154455168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744308.596752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744308.598886:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455168 00000100:00100000:0.0:1788744308.598902:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455168 00000100:00100000:0.0:1788744308.598972:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744308.598984:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154455168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744308.599013:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744308.599224:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154455168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744308.599233:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788744308.600798:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c46680 x1875634154455168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744308.600824:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154455168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744309.102758:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744309.630748:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744309.630773:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154455296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744309.631255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744309.631913:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455296 00000100:00100000:3.0:1788744309.631923:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455296 00000100:00100000:3.0:1788744309.631981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788744309.631991:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154455296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744309.632024:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744309.632126:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154455296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744309.632133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788744309.632521:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154455296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744309.774193:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744309.774232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744309.774255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744309.774286:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655104 00000100:00100000:1.0:1788744309.774295:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655104 00000100:00100000:1.0:1788744309.774347:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654976 00000100:00100000:1.0:1788744309.774351:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654976 00000100:00100000:1.0:1788744309.774373:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:1.0:1788744309.774383:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138655104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744309.774480:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138655104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744309.774488:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:1.0:1788744309.774516:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:1.0:1788744309.774523:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138654976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744309.774547:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138654976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744309.774553:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:3.0:1788744309.774726:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138654848 00000100:00100000:3.0:1788744309.774731:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138654848 00000100:00100000:3.0:1788744309.774779:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 286 00000100:00100000:3.0:1788744309.775577:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138654848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744309.775622:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2394:x1875634138654848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744309.780122:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 286 00000100:00080000:3.0:1788744309.780176:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744309.780182:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788744310.126735:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744310.638562:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744310.638585:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154455424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744310.638649:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744310.638833:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455424 00000100:00100000:2.0:1788744310.638842:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455424 00000100:00100000:2.0:1788744310.638902:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788744310.638924:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154455424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744310.638956:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788744310.639006:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154455424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744310.639012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788744310.639518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154455424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788744311.152388:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744312.176746:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154455680:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.176812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744312.176864:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154456192:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.176887:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744312.176911:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154456704:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.176945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744312.176986:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788744312.176992:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154455808:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177017:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744312.177035:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154456320:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177052:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744312.177068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154456832:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177088:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744312.177120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455680 00000100:00100000:3.0:1788744312.177128:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455680 00000100:00100000:3.0:1788744312.177164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456192 00000100:00100000:3.0:1788744312.177167:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456192 00000100:00100000:3.0:1788744312.177190:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456704 00000100:00100000:3.0:1788744312.177193:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456704 00000100:00100000:3.0:1788744312.177205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456320 00000100:00100000:3.0:1788744312.177207:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456320 00000100:00100000:3.0:1788744312.177216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456832 00000100:00100000:3.0:1788744312.177218:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456832 00000100:00100000:3.0:1788744312.177232:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744312.177240:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154455680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177303:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154455680:12345-0@lo:400:kworker.0 Request processed in 63us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.177310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744312.177328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744312.177334:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154456192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177364:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154456192:12345-0@lo:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.177370:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744312.177381:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788744312.177393:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154456704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177445:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154456704:12345-0@lo:400:kworker.0 Request processed in 52us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.177451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788744312.177463:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788744312.177469:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154456320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177508:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154456320:12345-0@lo:400:kworker.0 Request processed in 40us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.177514:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788744312.177525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744312.177530:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154456832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177556:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154456832:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.177561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744312.177588:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455808 00000100:00100000:3.0:1788744312.177593:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455808 00000100:00100000:3.0:1788744312.177621:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788744312.177627:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177658:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154455808:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.177663:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788744312.177685:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744312.177688:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744312.177716:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154455808:0@lo:400:kworker.0 00010000:00080000:3.0:1788744312.177737:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7480 x1875634154456320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744312.177759:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154456320:0@lo:400:kworker.0 00010000:00080000:3.0:1788744312.177770:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5500 x1875634154456832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744312.177778:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154456832:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177788:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154455680:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177796:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154456192:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.177804:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154456704:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.179789:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154455552:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.179855:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.179900:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154456064:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.180007:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.180039:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154456576:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.180067:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.180085:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154457088:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.180105:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.180129:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788744312.180136:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154455936:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.180161:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.180178:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154456448:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.180198:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.180217:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154456960:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.180239:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.180274:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455552 00000100:00100000:0.0:1788744312.180504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456064 00000100:00100000:0.0:1788744312.180512:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456064 00000100:00100000:0.0:1788744312.180563:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788744312.180572:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154456064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.181118:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456576 00000100:00100000:3.0:1788744312.181125:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456576 00000100:00100000:3.0:1788744312.181158:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457088 00000100:00100000:3.0:1788744312.181161:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457088 00000100:00100000:3.0:1788744312.181173:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456448 00000100:00100000:3.0:1788744312.181175:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456448 00000100:00100000:3.0:1788744312.181186:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154456960 00000100:00100000:3.0:1788744312.181189:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154456960 00000100:00100000:3.0:1788744312.181203:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744312.181210:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154456576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.181265:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154456576:12345-0@lo:400:kworker.0 Request processed in 55us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.181272:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788744312.181543:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455552 00000100:00100000:1.0:1788744312.181600:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788744312.181727:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154456064:12345-0@lo:400:kworker.0 Request processed in 1155us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744312.181736:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788744312.181762:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744312.181771:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154457088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744312.181803:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154457088:12345-0@lo:400:kworker.0 Request processed in 34us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744312.181818:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744312.181831:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744312.181837:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154456448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744312.181866:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154456448:12345-0@lo:400:kworker.0 Request processed in 29us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744312.181872:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744312.181883:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744312.181888:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154456960:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788744312.182854:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4e00 x1875634154456448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744312.182870:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154456448:0@lo:400:kworker.0 00010000:00080000:3.0:1788744312.182882:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7100 x1875634154456960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744312.182897:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154456960:0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.182910:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154456064:0@lo:400:kworker.0 00010000:00080000:3.0:1788744312.183003:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5f80 x1875634154456576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744312.183011:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154456576:0@lo:400:kworker.0 00010000:00080000:3.0:1788744312.183022:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5880 x1875634154457088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744312.183029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154457088:0@lo:400:kworker.0 00000100:00080000:3.0:1788744312.183059:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744312.183063:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744312.183075:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154455936 00000100:00100000:3.0:1788744312.183080:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154455936 00000100:00100000:3.0:1788744312.183114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788744312.183122:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154455936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744312.183192:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154455936:12345-0@lo:400:kworker.0 Request processed in 71us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744312.183199:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788744312.183228:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154455936:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.183297:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.183344:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154455552:12345-0@lo:400:kworker.0 Request processed in 53us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744312.183351:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788744312.184032:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154456960:12345-0@lo:400:kworker.0 Request processed in 25us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744312.184045:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:0.0:1788744312.184147:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744312.185227:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154455552:0@lo:400:kworker.0 00000100:00100000:1.0:1788744312.690916:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744312.690940:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154457216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744312.691003:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.691071:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457216 00000100:00100000:1.0:1788744312.691079:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457216 00000100:00100000:1.0:1788744312.691123:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744312.691132:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154457216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744312.691172:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744312.691250:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154457216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744312.691259:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788744312.691339:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c46300 x1875634154457216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744312.691358:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154457216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744312.698442:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744312.698485:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154457344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744312.698554:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744312.698891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457344 00000100:00100000:1.0:1788744312.698900:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457344 00000100:00100000:1.0:1788744312.698963:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744312.698974:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154457344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744312.698997:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744312.699044:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154457344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744312.699063:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788744312.699702:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643c44380 x1875634154457344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744312.699723:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154457344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744313.198629:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154457472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744313.198703:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744313.198806:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457472 00000100:00100000:3.0:1788744313.198815:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457472 00000100:00100000:3.0:1788744313.198868:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744313.198879:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154457472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744313.198917:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744313.198968:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154457472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744313.198975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788744313.199011:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bd180 x1875634154457472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744313.199029:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154457472:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788744313.199486:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744313.715770:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744313.715791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154457600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744313.715859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744313.715920:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457600 00000100:00100000:3.0:1788744313.715928:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457600 00000100:00100000:3.0:1788744313.715969:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788744313.715977:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154457600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744313.715998:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744313.716041:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154457600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744313.716048:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788744313.716083:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bd180 x1875634154457600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744313.716100:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154457600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744314.222579:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744314.734941:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744314.738064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154457728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744314.738143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744314.738613:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457728 00000100:00100000:3.0:1788744314.738622:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457728 00000100:00100000:3.0:1788744314.738713:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788744314.738736:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154457728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744314.738772:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744314.738831:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154457728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744314.738839:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788744314.738916:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154457728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744314.894560:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744314.894596:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744314.894630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744314.894674:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655360 00000100:00100000:2.0:1788744314.894684:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655360 00000100:00100000:2.0:1788744314.894740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655488 00000100:00100000:2.0:1788744314.894744:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655488 00000100:00100000:2.0:1788744314.894768:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788744314.894778:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138655360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744314.894850:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138655360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744314.894858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788744314.894897:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:2.0:1788744314.894904:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138655488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744314.894932:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138655488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744314.894939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00080000:2.0:1788744314.894960:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744314.894964:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744314.898142:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655232 00000100:00100000:3.0:1788744314.898155:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655232 00000100:00100000:3.0:1788744314.898426:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 288 00000100:00100000:3.0:1788744314.898438:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2396:x1875634138655232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744314.898524:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2396:x1875634138655232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744314.898531:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 288 00010000:00010000:0.0:1788744315.246532:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744315.762146:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154457856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744315.762210:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744315.762840:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457856 00000100:00100000:0.0:1788744315.762849:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457856 00000100:00100000:0.0:1788744315.762897:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788744315.762906:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154457856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744315.762944:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744315.762994:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154457856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744315.763011:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788744315.763797:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154457856:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744316.271090:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744317.294743:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744317.294784:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154458368:0@lo:400:kworker.0 00000100:00100000:3.0:1788744317.294826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154458240:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.294861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744317.294868:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744317.294928:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154458880:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.294932:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154458112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.294953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.294956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.294971:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154458624:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.294980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154459392:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.294989:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744317.294996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.295003:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154459136:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.295021:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.295037:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788744317.295043:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154457984:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.295069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.295105:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154458496:0@lo:400:kworker.0 00000100:00100000:0.0:1788744317.295121:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154457984 00000100:00100000:1.0:1788744317.295126:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744317.295129:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154457984 00000100:00100000:1.0:1788744317.295141:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154459008:0@lo:400:kworker.0 00000100:00100000:0.0:1788744317.295171:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788744317.295180:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154457984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.295234:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458368 00000100:00100000:2.0:1788744317.295239:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458368 00000100:00100000:2.0:1788744317.295266:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458112 00000100:00100000:2.0:1788744317.295269:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458112 00000100:00100000:2.0:1788744317.295279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458624 00000100:00100000:2.0:1788744317.295282:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458624 00000100:00100000:2.0:1788744317.295301:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459136 00000100:00100000:2.0:1788744317.295304:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459136 00000100:00100000:2.0:1788744317.295323:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788744317.295329:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154458368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.296859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.296899:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154459520:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.296953:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.296994:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154457984:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.297033:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458880 00000100:00100000:1.0:1788744317.297038:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458880 00000100:00100000:1.0:1788744317.297071:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459392 00000100:00100000:1.0:1788744317.297074:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459392 00000100:00100000:1.0:1788744317.297362:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459008 00000100:00100000:1.0:1788744317.297367:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459008 00000100:00100000:1.0:1788744317.297380:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459520 00000100:00100000:1.0:1788744317.297382:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459520 00000100:00100000:1.0:1788744317.297397:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744317.297435:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.297503:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154458880:12345-0@lo:400:kworker.0 Request processed in 69us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.297509:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744317.297524:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744317.297530:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154459392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.297559:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154459392:12345-0@lo:400:kworker.0 Request processed in 29us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.297565:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744317.297576:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788744317.297582:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154459008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.297613:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154459008:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.297748:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788744317.297771:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788744317.297777:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154459520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.297808:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154459520:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.297814:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788744317.297846:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bd180 x1875634154459008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744317.297857:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154459008:0@lo:400:kworker.0 00010000:00080000:1.0:1788744317.297867:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431efb80 x1875634154459520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744317.297875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154459520:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.297916:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458240 00000100:00100000:1.0:1788744317.297921:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458240 00000100:00100000:1.0:1788744317.297956:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458496 00000100:00100000:1.0:1788744317.297959:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458496 00000100:00100000:1.0:1788744317.297973:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788744317.297979:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154458240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.298014:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154458240:12345-0@lo:400:kworker.0 Request processed in 35us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.298021:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788744317.298032:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744317.298038:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154458496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.298071:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154458496:12345-0@lo:400:kworker.0 Request processed in 33us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.298325:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744317.298362:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154458496:0@lo:400:kworker.0 00000100:00080000:1.0:1788744317.298495:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744317.298499:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744317.298503:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744317.298518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788744317.298526:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154458112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.298576:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154458368:12345-0@lo:400:kworker.0 Request processed in 3245us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.298583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788744317.298605:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788744317.298611:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154458624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.298648:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154458624:12345-0@lo:400:kworker.0 Request processed in 37us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.298654:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788744317.298666:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788744317.298673:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154459136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.298827:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154459136:12345-0@lo:400:kworker.0 Request processed in 155us (3805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.298834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1788744317.298988:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1f80 x1875634154459392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744317.298998:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154459392:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.299010:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154458368:0@lo:400:kworker.0 00010000:00080000:2.0:1788744317.299020:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7480 x1875634154458880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744317.299027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154458880:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.299056:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154458624:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.299065:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154459136:0@lo:400:kworker.0 00000100:00100000:0.0:1788744317.299212:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154457984:12345-0@lo:400:kworker.0 Request processed in 4031us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744317.299220:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788744317.299425:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154458240:0@lo:400:kworker.0 00000100:00100000:3.0:1788744317.299436:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154458752:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.299472:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154458112:12345-0@lo:400:kworker.0 Request processed in 945us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.299480:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788744317.299485:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744317.299570:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154459264:0@lo:400:kworker.0 00000100:00100000:3.0:1788744317.299596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744317.299600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154458112:0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.299851:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154458752 00000100:00100000:1.0:1788744317.299858:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154458752 00000100:00100000:1.0:1788744317.299903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788744317.299911:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744317.299948:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154458752:12345-0@lo:400:kworker.0 Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.299954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788744317.300019:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744317.303467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459264 00000100:00100000:2.0:1788744317.303482:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459264 00010000:00080000:3.0:1788744317.303501:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5500 x1875634154458752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744317.303528:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154458752:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.303572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788744317.303627:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744317.303762:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154459264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.303843:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154459264:12345-0@lo:400:kworker.0 Request processed in 263us (4246us total) trans 0 rc 0/0 00010000:00080000:1.0:1788744317.303896:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f3800 x1875634154459264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744317.303907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154459264:0@lo:400:kworker.0 00000100:00100000:2.0:1788744317.305510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788744317.806719:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154459648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744317.806784:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744317.806910:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459648 00000100:00100000:0.0:1788744317.806918:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459648 00000100:00100000:0.0:1788744317.806973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744317.806983:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154459648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744317.807011:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744317.807113:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154459648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744317.807120:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788744317.807181:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431eed80 x1875634154459648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744317.807199:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154459648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744317.807593:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154459776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744317.807628:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744317.807687:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459776 00000100:00100000:0.0:1788744317.807693:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459776 00000100:00100000:0.0:1788744317.807719:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744317.807726:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154459776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744317.807738:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744317.807828:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154459776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744317.807834:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788744317.807879:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b7b100 x1875634154459776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744317.807891:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154459776:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788744317.990655:0:11991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:25:17 (1788744317) === 00010000:00010000:0.0:1788744318.318838:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744318.319151:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744318.319173:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154459904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744318.319240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744318.319425:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154459904 00000100:00100000:0.0:1788744318.319544:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154459904 00000100:00100000:0.0:1788744318.319587:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744318.319597:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154459904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744318.319625:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744318.319683:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154459904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.319691:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788744318.319932:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6431efb80 x1875634154459904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744318.319949:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154459904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744318.535696:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.535799:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655616 00000100:00100000:3.0:1788744318.535812:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655616 00000100:00100000:3.0:1788744318.535887:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:3.0:1788744318.535899:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:8731:x1875634138655616:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788744318.535922:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744318.535945:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcc271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d34d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.535982:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcc271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d34d expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.535996:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcc271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d34d expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.536007:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be600, rc 0) 00000100:00100000:3.0:1788744318.536765:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8731:x1875634138655616:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 861us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.536774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:1.0:1788744318.558725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.560452:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655744 00000100:00100000:0.0:1788744318.560470:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655744 00000100:00100000:0.0:1788744318.560560:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:0.0:1788744318.560574:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8731:x1875634138655744:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744318.560801:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8731:x1875634138655744:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 228us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.560810:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:2.0:1788744318.573547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.573793:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138655872 00000100:00100000:3.0:1788744318.573816:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138655872 00000100:00100000:3.0:1788744318.573870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:3.0:1788744318.573881:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8731:x1875634138655872:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788744318.574040:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8731:x1875634138655872:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 160us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.574048:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:3.0:1788744318.589470:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744318.589785:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656000 00000100:00100000:2.0:1788744318.589796:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656000 00000100:00100000:2.0:1788744318.589840:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:2.0:1788744318.589851:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8735:x1875634138656000:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744318.590019:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8735:x1875634138656000:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 169us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.590028:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:1.0:1788744318.624889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.624994:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656128 00000100:00100000:3.0:1788744318.625005:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656128 00000100:00100000:3.0:1788744318.625078:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 294 00000100:00100000:3.0:1788744318.625088:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8735:x1875634138656128:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744318.625245:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8735:x1875634138656128:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 151us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.625253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 294 00000100:00100000:1.0:1788744318.638550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.639044:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656256 00000100:00100000:0.0:1788744318.639055:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656256 00000100:00100000:0.0:1788744318.639120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:0.0:1788744318.639130:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8735:x1875634138656256:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744318.639297:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8735:x1875634138656256:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 167us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.639305:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:0.0:1788744318.652523:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744318.652680:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656384 00000100:00100000:2.0:1788744318.652690:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656384 00000100:00100000:2.0:1788744318.652739:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296 00000100:00100000:2.0:1788744318.652765:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:8731:x1875634138656384:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744318.652785:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744318.652803:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b82800/0xb6207a6e76dcc278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d37e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.652832:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b82800/0xb6207a6e76dcc278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d37e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.652845:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b82800/0xb6207a6e76dcc278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d37e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.652854:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82800, rc 0) 00000100:00100000:2.0:1788744318.652907:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:8731:x1875634138656384:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 144us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.652914:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296 00000100:00100000:1.0:1788744318.662347:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.662570:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656512 00000100:00100000:3.0:1788744318.662580:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656512 00000100:00100000:3.0:1788744318.662633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:3.0:1788744318.662643:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:8731:x1875634138656512:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788744318.662667:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788744318.662692:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788744318.662696:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788744318.662699:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788744318.662702:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788744318.662704:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788744318.664899:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:8731:x1875634138656512:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 2249us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.664913:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:0.0:1788744318.672197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744318.672809:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656640 00000100:00100000:1.0:1788744318.672820:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656640 00000100:00100000:1.0:1788744318.672878:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:1.0:1788744318.672889:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:8731:x1875634138656640:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744318.672908:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744318.672924:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d385 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.672952:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.672964:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.672972:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170a00, rc 0) 00000100:00100000:1.0:1788744318.673094:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8731:x1875634138656640:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 206us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744318.673101:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:1.0:1788744318.675687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.675766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656768 00000100:00100000:3.0:1788744318.675775:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656768 00000100:00100000:3.0:1788744318.675822:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:3.0:1788744318.675831:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8731:x1875634138656768:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788744318.676123:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8731:x1875634138656768:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 291us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.676132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:1.0:1788744318.679913:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744318.680343:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138656896 00000100:00100000:2.0:1788744318.680354:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138656896 00000100:00100000:2.0:1788744318.681150:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00100000:2.0:1788744318.681164:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8731:x1875634138656896:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788744318.681325:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8731:x1875634138656896:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 164us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.681333:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00100000:0.0:1788744318.685100:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744318.686336:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657024 00000100:00100000:1.0:1788744318.686349:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657024 00000100:00100000:1.0:1788744318.686398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 301 00000100:00100000:1.0:1788744318.686699:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8740:x1875634138657024:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744318.686849:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8740:x1875634138657024:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 153us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744318.686867:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 301 00000100:00100000:1.0:1788744318.701219:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.702365:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657152 00000100:00100000:0.0:1788744318.702377:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657152 00000100:00100000:0.0:1788744318.702628:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 302 00000100:00100000:0.0:1788744318.702638:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8740:x1875634138657152:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744318.702790:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:8740:x1875634138657152:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 153us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.702797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 302 00000100:00100000:0.0:1788744318.714845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.714892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.715023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744318.718368:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657920 00000100:00100000:2.0:1788744318.718383:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657920 00000100:00100000:1.0:1788744318.718660:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658048 00000100:00100000:1.0:1788744318.718665:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658048 00000100:00100000:0.0:1788744318.718702:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:0.0:1788744318.719155:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744318.719160:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744318.719194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657280 00000100:00100000:2.0:1788744318.719195:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657536 00000100:00100000:3.0:1788744318.719201:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657280 00000100:00100000:2.0:1788744318.719203:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657536 00000100:00100000:2.0:1788744318.720142:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:2.0:1788744318.720158:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138657920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744318.720175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788744318.720184:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875634138657536:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788744318.720211:0:6515:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from d3d8d0a9-44d4-48ca-8f27-65a3656deb18@192.168.203.4@tcp t0 exp 0000000000000000 cur 300 last 0 00000100:00100000:2.0:1788744318.720253:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138657920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 100us (5848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.720263:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000020:00000080:0.0:1788744318.720264:0:6515:0:(genops.c:1384:class_connect()) connect: client d3d8d0a9-44d4-48ca-8f27-65a3656deb18, cookie 0xb6207a6e76dcc286 00000100:00100000:2.0:1788744318.720283:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000004:00100000:0.0:1788744318.720289:0:6515:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788744318.720291:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138658048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744318.720317:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138658048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.720325:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1788744318.720338:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788744318.720344:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1875634138657280:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788744318.720358:0:10509:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from d3d8d0a9-44d4-48ca-8f27-65a3656deb18@192.168.203.4@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:2.0:1788744318.720386:0:10509:0:(genops.c:1384:class_connect()) connect: client d3d8d0a9-44d4-48ca-8f27-65a3656deb18, cookie 0xb6207a6e76dcc28d 00000004:00100000:2.0:1788744318.720416:0:10509:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788744318.720554:0:10509:0:(import.c:65:import_set_state_nolock()) ffff9ac6427df800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744318.720580:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2393:x1875634138657280:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 235us (5557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.720586:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00080000:0.0:1788744318.720933:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744318.720965:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2393:x1875634138657536:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 780us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.720974:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788744318.728689:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.728754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.728832:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.729658:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657408 00000100:00100000:0.0:1788744318.729670:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657408 00000100:00100000:0.0:1788744318.729734:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657792 00000100:00100000:0.0:1788744318.729738:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657792 00000100:00100000:0.0:1788744318.729749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138657664 00000100:00100000:0.0:1788744318.729752:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138657664 00000100:00100000:0.0:1788744318.729771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788744318.729792:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+7:0:x1875634138657408:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744318.729834:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744318.729921:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+7:0:x1875634138657408:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 131us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.729929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788744318.729946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788744318.729953:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138657792:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744318.729965:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744318.729988:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138657792:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 36us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.729994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788744318.730077:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788744318.730085:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:0:x1875634138657664:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744318.730101:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744318.730155:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:0:x1875634138657664:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 70us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.730162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00080000:3.0:1788744318.730788:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744318.730793:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744318.733182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744318.733290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658176 00000100:00100000:2.0:1788744318.733300:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658176 00000100:00100000:2.0:1788744318.733357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788744318.733366:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138658176:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788744318.733740:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138658176:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 373us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.733748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788744318.736052:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.737569:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.739524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744318.739639:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658560 00000100:00100000:0.0:1788744318.739649:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658560 00000100:00100000:0.0:1788744318.739706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788744318.739717:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138658560:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788744318.739809:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138658560:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.739817:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788744318.741653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744318.741757:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658688 00000100:00100000:3.0:1788744318.741768:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658688 00000100:00100000:3.0:1788744318.741824:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788744318.741835:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138658688:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788744318.741924:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788744318.742001:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:8731:x1875634138658688:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.742009:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788744318.746331:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658304 00000100:00100000:1.0:1788744318.746346:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658304 00000100:00100000:0.0:1788744318.746593:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658432 00000100:00100000:0.0:1788744318.746599:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658432 00000100:00100000:0.0:1788744318.746630:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788744318.746638:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875634138658304:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788744318.746670:0:8430:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from d3d8d0a9-44d4-48ca-8f27-65a3656deb18@192.168.203.4@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1788744318.746701:0:8430:0:(genops.c:1384:class_connect()) connect: client d3d8d0a9-44d4-48ca-8f27-65a3656deb18, cookie 0xb6207a6e76dcc294 00002000:00100000:0.0:1788744318.746713:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d3d8d0a9-44d4-48ca-8f27-65a3656deb18/ffff9ac77cb36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744318.746723:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788744318.746809:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788744318.746840:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac77cb31800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744318.746909:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2393:x1875634138658304:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 270us (10865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.746917:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788744318.746935:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788744318.746940:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875634138658432:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788744318.746975:0:8430:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from d3d8d0a9-44d4-48ca-8f27-65a3656deb18@192.168.203.4@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1788744318.746991:0:8430:0:(genops.c:1384:class_connect()) connect: client d3d8d0a9-44d4-48ca-8f27-65a3656deb18, cookie 0xb6207a6e76dcc29b 00002000:00100000:0.0:1788744318.746997:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d3d8d0a9-44d4-48ca-8f27-65a3656deb18/ffff9ac77cb31000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744318.747003:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788744318.747045:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788744318.747060:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac77cb33800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744318.747085:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2393:x1875634138658432:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 143us (9522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744318.747092:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788744318.830815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744318.830839:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154460032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744318.830907:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744318.831069:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460032 00000100:00100000:3.0:1788744318.831079:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460032 00000100:00100000:3.0:1788744318.831131:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744318.831141:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154460032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744318.831183:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744318.831251:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154460032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.831258:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788744318.831428:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9c700 x1875634154460032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744318.831458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154460032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744319.344156:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744319.854845:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154460160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744319.854936:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744319.855158:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460160 00000100:00100000:1.0:1788744319.855169:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460160 00000100:00100000:1.0:1788744319.855358:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788744319.855374:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154460160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744319.855456:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744319.855525:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154460160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.855613:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154460160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744319.860371:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:2.0:1788744320.369603:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744320.878700:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154460288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744320.878775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744320.878905:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460288 00000100:00100000:0.0:1788744320.878914:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460288 00000100:00100000:0.0:1788744320.878969:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788744320.878982:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154460288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744320.879025:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744320.879075:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154460288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.879083:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788744320.879125:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154460288:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744321.390618:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744322.414802:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154460544:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.414869:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744322.414931:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154461056:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.414955:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744322.414976:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154461568:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.414996:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744322.415020:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788744322.415026:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154460672:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.415055:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744322.415074:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154461184:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.415111:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744322.415125:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154461696:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.415143:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744322.415174:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460672 00000100:00100000:3.0:1788744322.415182:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460672 00000100:00100000:3.0:1788744322.415351:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744322.415362:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7603ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154460672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.415447:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7603ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154460672:12345-0@lo:400:kworker.0 Request processed in 87us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744322.415455:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744322.415765:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154460672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.415904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154460416:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.415937:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.415971:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154460928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.415992:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.416011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154461440:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416031:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.416047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154461952:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416065:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.416082:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788744322.416100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154460800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416121:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.416132:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154461312:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.416169:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154461824:0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416186:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.416211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460544 00000100:00100000:2.0:1788744322.416335:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460544 00000100:00100000:2.0:1788744322.416368:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461056 00000100:00100000:2.0:1788744322.416371:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461056 00000100:00100000:2.0:1788744322.416396:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461568 00000100:00100000:2.0:1788744322.416434:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461568 00000100:00100000:2.0:1788744322.416450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461184 00000100:00100000:2.0:1788744322.416453:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461184 00000100:00100000:2.0:1788744322.416464:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461696 00000100:00100000:2.0:1788744322.416476:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461696 00000100:00100000:2.0:1788744322.416493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460800 00000100:00100000:2.0:1788744322.416495:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460800 00000100:00100000:2.0:1788744322.416509:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788744322.416514:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416558:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154460544:12345-0@lo:400:kworker.0 Request processed in 43us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788744322.416578:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744322.416584:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154461056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416610:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154461056:12345-0@lo:400:kworker.0 Request processed in 26us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416615:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744322.416626:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744322.416631:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154461568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416656:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154461568:12345-0@lo:400:kworker.0 Request processed in 26us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744322.416673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788744322.416678:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154461184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416704:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154461184:12345-0@lo:400:kworker.0 Request processed in 26us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788744322.416721:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788744322.416726:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154461696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416751:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154461696:12345-0@lo:400:kworker.0 Request processed in 25us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788744322.416774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788744322.416780:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154460800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416815:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154460800:12345-0@lo:400:kworker.0 Request processed in 34us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788744322.416859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460928 00000100:00100000:2.0:1788744322.416863:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460928 00000100:00100000:2.0:1788744322.416886:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744322.416892:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154460928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.416923:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154460928:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.416928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744322.416947:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461440 00000100:00100000:2.0:1788744322.416950:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461440 00000100:00100000:2.0:1788744322.416968:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461952 00000100:00100000:2.0:1788744322.416972:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461952 00000100:00100000:2.0:1788744322.416983:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461312 00000100:00100000:2.0:1788744322.416985:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461312 00000100:00100000:2.0:1788744322.416995:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154461824 00000100:00100000:2.0:1788744322.416997:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154461824 00000100:00100000:2.0:1788744322.417007:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788744322.417013:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154461440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.417042:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154461440:12345-0@lo:400:kworker.0 Request processed in 28us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.417047:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744322.417445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154460416 00000100:00100000:3.0:1788744322.417451:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154460416 00000100:00100000:3.0:1788744322.417479:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788744322.417487:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154460416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.417521:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154460416:12345-0@lo:400:kworker.0 Request processed in 35us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744322.417527:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1788744322.417573:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744322.417578:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744322.417580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744322.417583:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744322.417762:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744322.417778:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154461952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744322.417811:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154461952:12345-0@lo:400:kworker.0 Request processed in 35us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744322.425971:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788744322.425999:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154461312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426114:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154461312:12345-0@lo:400:kworker.0 Request processed in 129us (9960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744322.426122:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788744322.426154:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744322.426161:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154461824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426193:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154461824:12345-0@lo:400:kworker.0 Request processed in 34us (10005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744322.426199:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788744322.426484:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25c00 x1875634154461184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744322.426498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154461184:0@lo:400:kworker.0 00010000:00080000:3.0:1788744322.426512:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25880 x1875634154461696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744322.426535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154461696:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154460544:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426560:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154461056:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426570:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154461568:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426620:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154460800:0@lo:400:kworker.0 00010000:00080000:3.0:1788744322.426636:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25f80 x1875634154461312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744322.426645:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154461312:0@lo:400:kworker.0 00010000:00080000:3.0:1788744322.426656:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a24e00 x1875634154461824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744322.426663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154461824:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426672:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154460416:0@lo:400:kworker.0 00000100:00100000:3.0:1788744322.426682:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154460928:0@lo:400:kworker.0 00010000:00080000:3.0:1788744322.426690:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25500 x1875634154461440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744322.426697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154461440:0@lo:400:kworker.0 00010000:00080000:3.0:1788744322.426706:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a27b80 x1875634154461952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744322.426712:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154461952:0@lo:400:kworker.0 00010000:00010000:3.0:1788744322.432710:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744322.438534:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744322.928007:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154462080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744322.928087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744322.928641:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744322.928651:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154462208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744322.928693:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744322.928803:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462080 00000100:00100000:2.0:1788744322.928812:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462080 00000100:00100000:2.0:1788744322.928846:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462208 00000100:00100000:2.0:1788744322.928849:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462208 00000100:00100000:2.0:1788744322.928863:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744322.928872:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154462080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744322.928911:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744322.928961:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154462080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.928969:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744322.928985:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744322.928991:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154462208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744322.929000:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744322.929023:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154462208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744322.929029:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788744322.929148:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b7b100 x1875634154462208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744322.929166:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154462208:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788744322.929177:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9dc00 x1875634154462080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744322.929188:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154462080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744323.438639:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744323.438666:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154462336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744323.438751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744323.438907:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462336 00000100:00100000:3.0:1788744323.438917:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462336 00000100:00100000:3.0:1788744323.438975:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744323.438984:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154462336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744323.439017:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744323.439060:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154462336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744323.439066:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788744323.439107:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9df80 x1875634154462336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744323.439127:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154462336:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788744323.439284:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744323.952491:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154462464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744323.953083:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744323.954685:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462464 00000100:00100000:0.0:1788744323.954696:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462464 00000100:00100000:0.0:1788744323.954744:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744323.954752:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154462464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744323.954774:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744323.954840:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154462464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744323.954846:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788744323.954888:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9df80 x1875634154462464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744323.954906:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154462464:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788744324.005727:0:12184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788744324.113998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114032:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114085:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114121:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744324.114159:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659584 00000100:00100000:0.0:1788744324.114169:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659584 00000100:00100000:0.0:1788744324.114219:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659456 00000100:00100000:0.0:1788744324.114222:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659456 00000100:00100000:0.0:1788744324.114240:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1788744324.114249:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744324.114328:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744324.114337:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788744324.114352:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658816 00000100:00100000:0.0:1788744324.114357:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1788744324.114359:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658816 00000100:00100000:0.0:1788744324.114366:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744324.114394:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744324.114428:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 304 00000100:00100000:0.0:1788744324.114438:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1788744324.114440:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138658816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744324.114459:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659072 00000100:00100000:0.0:1788744324.114463:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659072 00000100:00100000:2.0:1788744324.114475:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138658816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744324.114490:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659328 00000100:00100000:2.0:1788744324.114495:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 304 00000100:00100000:0.0:1788744324.114495:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659328 00000100:00100000:0.0:1788744324.114512:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138658944 00000100:00100000:0.0:1788744324.114516:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138658944 00000100:00100000:0.0:1788744324.114534:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659200 00000100:00100000:0.0:1788744324.114536:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659200 00000100:00100000:2.0:1788744324.114539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:2.0:1788744324.114551:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138659072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744324.114557:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:0.0:1788744324.114565:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744324.114584:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138659072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744324.114592:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:0.0:1788744324.114599:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744324.114606:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:2.0:1788744324.121064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:2.0:1788744324.121086:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138658944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744324.121183:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138658944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 107us (7096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744324.121191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:2.0:1788744324.121233:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:2.0:1788744324.121241:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744324.121269:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2395:x1875634138659200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (7168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744324.121275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00080000:0.0:1788744324.123435:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744324.123444:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744324.123448:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744324.123450:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788744324.463476:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744324.470614:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00100000:3.0:1788744324.470918:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00100000:2.0:1788744324.479951:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00100000:0.0:1788744324.481452:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000100:00100000:0.0:1788744324.974676:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154462592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744324.974742:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744324.974842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462592 00000100:00100000:1.0:1788744324.974851:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462592 00000100:00100000:1.0:1788744324.974901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788744324.974910:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154462592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744324.974942:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744324.975003:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154462592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744324.975010:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788744324.975053:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154462592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744325.487623:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744326.007535:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744326.007561:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154462720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744326.007910:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744326.015624:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462720 00000100:00100000:3.0:1788744326.015641:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462720 00000100:00100000:3.0:1788744326.015693:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744326.015706:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154462720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744326.015744:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788744326.015844:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154462720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (7934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744326.015850:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788744326.016318:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154462720:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744326.510598:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744327.534608:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154462848:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534676:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154463360:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534758:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154463872:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534795:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154464384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534831:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788744327.534836:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154462976:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534869:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154464000:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534913:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534941:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154463104:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534962:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.534978:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154463616:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.534995:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.535009:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154464128:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535025:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.535048:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788744327.535054:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154463232:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535073:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.535083:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154463744:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535101:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.535115:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154464256:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535133:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744327.535174:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463360 00000100:00100000:1.0:1788744327.535181:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463360 00000100:00100000:1.0:1788744327.535222:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463104 00000100:00100000:1.0:1788744327.535226:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463104 00000100:00100000:1.0:1788744327.535245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788744327.535253:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154463360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535303:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154463360:12345-0@lo:400:kworker.0 Request processed in 50us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788744327.535328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788744327.535334:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154463104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535364:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154463104:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788744327.535417:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463872 00000100:00100000:1.0:1788744327.535421:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463872 00000100:00100000:1.0:1788744327.535447:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464384 00000100:00100000:1.0:1788744327.535450:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464384 00000100:00100000:1.0:1788744327.535460:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463744 00000100:00100000:1.0:1788744327.535462:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463744 00000100:00100000:1.0:1788744327.535472:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464256 00000100:00100000:1.0:1788744327.535479:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464256 00000100:00100000:1.0:1788744327.535494:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744327.535499:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154463872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535529:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154463872:12345-0@lo:400:kworker.0 Request processed in 30us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535534:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744327.535545:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744327.535550:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154464384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535575:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154464384:12345-0@lo:400:kworker.0 Request processed in 26us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535581:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744327.535591:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744327.535597:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154463744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535619:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154463744:12345-0@lo:400:kworker.0 Request processed in 23us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535625:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744327.535635:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744327.535640:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154464256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535662:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154464256:12345-0@lo:400:kworker.0 Request processed in 22us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535668:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744327.535683:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462976 00000100:00100000:1.0:1788744327.535686:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462976 00000100:00100000:1.0:1788744327.535700:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463488 00000100:00100000:1.0:1788744327.535703:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463488 00000100:00100000:1.0:1788744327.535712:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464000 00000100:00100000:1.0:1788744327.535714:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464000 00000100:00100000:1.0:1788744327.535733:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463616 00000100:00100000:1.0:1788744327.535736:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463616 00000100:00100000:1.0:1788744327.535744:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464128 00000100:00100000:1.0:1788744327.535746:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464128 00000100:00100000:1.0:1788744327.535754:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154463232 00000100:00100000:1.0:1788744327.535757:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154463232 00000100:00100000:1.0:1788744327.535768:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788744327.535773:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154462976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535800:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154462976:12345-0@lo:400:kworker.0 Request processed in 27us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535806:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788744327.535817:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788744327.535822:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154463488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535845:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154463488:12345-0@lo:400:kworker.0 Request processed in 23us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535850:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788744327.535860:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788744327.535865:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535886:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154464000:12345-0@lo:400:kworker.0 Request processed in 22us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535892:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788744327.535901:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788744327.535906:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154463616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535926:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154463616:12345-0@lo:400:kworker.0 Request processed in 21us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535932:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788744327.535942:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788744327.535952:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154464128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.535976:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154464128:12345-0@lo:400:kworker.0 Request processed in 25us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.535981:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788744327.535991:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788744327.535996:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154463232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.536018:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154463232:12345-0@lo:400:kworker.0 Request processed in 22us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744327.536024:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788744327.536055:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788744327.536059:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744327.536061:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744327.536063:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744327.536091:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154462976:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.536103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.536112:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154464000:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.536122:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154463360:0@lo:400:kworker.0 00010000:00080000:1.0:1788744327.536133:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a24380 x1875634154463872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744327.536143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154463872:0@lo:400:kworker.0 00010000:00080000:1.0:1788744327.536152:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a26300 x1875634154464384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744327.536160:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154464384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.536206:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154463232:0@lo:400:kworker.0 00010000:00080000:1.0:1788744327.536216:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a26680 x1875634154463744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744327.536224:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154463744:0@lo:400:kworker.0 00010000:00080000:1.0:1788744327.536232:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25180 x1875634154464256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744327.536240:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154464256:0@lo:400:kworker.0 00000100:00100000:1.0:1788744327.536249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154463104:0@lo:400:kworker.0 00010000:00080000:1.0:1788744327.536257:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a24000 x1875634154463616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744327.536265:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154463616:0@lo:400:kworker.0 00010000:00080000:1.0:1788744327.536275:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25c00 x1875634154464128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744327.536283:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154464128:0@lo:400:kworker.0 00010000:00010000:3.0:1788744327.537724:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744327.537746:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154462848 00000100:00100000:3.0:1788744327.537756:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154462848 00000100:00100000:3.0:1788744327.537805:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788744327.537814:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154462848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744327.537891:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154462848:12345-0@lo:400:kworker.0 Request processed in 79us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744327.537898:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788744327.540000:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154462848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744328.046711:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154464512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744328.046802:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744328.047190:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464512 00000100:00100000:0.0:1788744328.047198:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464512 00000100:00100000:0.0:1788744328.047245:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788744328.047256:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154464512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744328.047285:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744328.047334:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154464512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744328.047341:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788744328.047361:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744328.047371:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154464640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744328.047429:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744328.047455:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464640 00000100:00100000:0.0:1788744328.047460:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464640 00000100:00100000:0.0:1788744328.047477:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744328.047483:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154464640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744328.047494:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744328.047524:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154464640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744328.047541:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788744328.047876:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce5180 x1875634154464640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744328.047894:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154464640:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788744328.048016:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b7b100 x1875634154464512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744328.048029:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154464512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744328.558686:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744328.558710:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154464768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744328.558791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744328.558921:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464768 00000100:00100000:3.0:1788744328.558945:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464768 00000100:00100000:3.0:1788744328.558994:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744328.559003:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154464768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744328.559030:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744328.559082:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154464768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744328.559090:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788744328.559225:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9d880 x1875634154464768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744328.559246:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154464768:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788744328.559493:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744329.070837:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744329.070861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154464896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744329.070930:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744329.071242:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154464896 00000100:00100000:1.0:1788744329.071251:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154464896 00000100:00100000:1.0:1788744329.074725:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788744329.074742:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154464896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744329.074769:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744329.074848:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154464896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744329.074856:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788744329.076024:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744329.076072:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9ce00 x1875634154464896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744329.076096:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154464896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744329.229880:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.229940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.229971:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.229995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.230015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.230039:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.230063:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744329.230088:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659968 00000100:00100000:3.0:1788744329.230110:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659968 00000100:00100000:3.0:1788744329.230164:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660224 00000100:00100000:3.0:1788744329.230167:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660224 00000100:00100000:3.0:1788744329.230196:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659840 00000100:00100000:3.0:1788744329.230199:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659840 00000100:00100000:3.0:1788744329.230210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660096 00000100:00100000:3.0:1788744329.230212:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660096 00000100:00100000:3.0:1788744329.230228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:3.0:1788744329.230237:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138659968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744329.230312:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138659968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744329.230320:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:3.0:1788744329.230337:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:3.0:1788744329.230344:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744329.230367:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744329.230384:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:3.0:1788744329.230397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:3.0:1788744329.230441:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138659840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744329.230465:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138659840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744329.230471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:3.0:1788744329.230483:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:3.0:1788744329.230488:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744329.230509:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744329.230524:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00080000:3.0:1788744329.231085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744329.231091:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744329.231712:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138659712 00000100:00100000:2.0:1788744329.231724:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138659712 00000100:00100000:2.0:1788744329.231784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 306 00000100:00100000:2.0:1788744329.231794:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138659712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744329.231852:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138659712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744329.231859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 306 00000100:00100000:1.0:1788744329.232364:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660480 00000100:00100000:1.0:1788744329.232380:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660480 00000100:00100000:1.0:1788744329.232467:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660352 00000100:00100000:1.0:1788744329.232471:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660352 00000100:00100000:1.0:1788744329.232493:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788744329.232500:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744329.232543:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744329.232558:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788744329.232572:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:1.0:1788744329.232578:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744329.232602:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744329.232607:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00080000:2.0:1788744329.233182:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744329.233187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788744329.584322:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744330.101536:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744330.101563:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154465024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744330.101666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744330.101820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465024 00000100:00100000:1.0:1788744330.101830:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465024 00000100:00100000:1.0:1788744330.101893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788744330.101904:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154465024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744330.101943:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744330.101994:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154465024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744330.102001:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788744330.102049:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154465024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788744330.606825:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744331.120700:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744331.120731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154465152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744331.120828:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744331.128249:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465152 00000100:00100000:1.0:1788744331.128268:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465152 00000100:00100000:0.0:1788744331.128487:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788744331.128500:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154465152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744331.128552:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744331.128661:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154465152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (7832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744331.128668:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788744331.128729:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154465152:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744331.631610:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788744331.786113:0:12500:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744331.786500:0:12500:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788744332.656685:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154465280:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.656941:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154465664:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657284:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657374:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154466176:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154466688:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657499:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657533:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744332.657541:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154465792:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657606:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154466304:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657696:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154466816:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657736:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657771:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154465408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657828:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154465920:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657881:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154466432:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657907:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.657947:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788744332.657955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154465536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.657981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.658002:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154466048:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744332.658045:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154466560:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658086:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744332.658117:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744332.658136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465664 00000100:00100000:2.0:1788744332.658147:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465664 00000100:00100000:2.0:1788744332.658198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465408 00000100:00100000:2.0:1788744332.658202:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465408 00000100:00100000:2.0:1788744332.658218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465920 00000100:00100000:2.0:1788744332.658221:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465920 00000100:00100000:2.0:1788744332.658249:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466432 00000100:00100000:2.0:1788744332.658253:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466432 00000100:00100000:2.0:1788744332.658268:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466048 00000100:00100000:2.0:1788744332.658270:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466048 00000100:00100000:2.0:1788744332.658280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466560 00000100:00100000:2.0:1788744332.658282:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466560 00000100:00100000:2.0:1788744332.658298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788744332.658307:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154465664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658388:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154465664:12345-0@lo:400:kworker.0 Request processed in 82us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658397:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788744332.658456:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788744332.658463:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154465408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658499:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154465408:12345-0@lo:400:kworker.0 Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658504:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788744332.658518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788744332.658523:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154465920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658552:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154465920:12345-0@lo:400:kworker.0 Request processed in 28us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788744332.658592:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788744332.658598:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154466432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658632:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154466432:12345-0@lo:400:kworker.0 Request processed in 34us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658638:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788744332.658651:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788744332.658657:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154466048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658689:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154466048:12345-0@lo:400:kworker.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788744332.658708:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744332.658715:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154466560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658744:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154466560:12345-0@lo:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744332.658775:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466176 00000100:00100000:2.0:1788744332.658779:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466176 00000100:00100000:2.0:1788744332.658805:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466688 00000100:00100000:2.0:1788744332.658809:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466688 00000100:00100000:2.0:1788744332.658822:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466304 00000100:00100000:2.0:1788744332.658826:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466304 00000100:00100000:2.0:1788744332.658840:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466816 00000100:00100000:2.0:1788744332.658842:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466816 00000100:00100000:2.0:1788744332.658857:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744332.658865:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154466176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658910:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154466176:12345-0@lo:400:kworker.0 Request processed in 47us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658918:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744332.658928:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744332.658933:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154466688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.658958:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154466688:12345-0@lo:400:kworker.0 Request processed in 25us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.658964:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744332.658975:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744332.658981:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154466304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659013:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154466304:12345-0@lo:400:kworker.0 Request processed in 33us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.659019:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744332.659031:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744332.659037:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154466816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659063:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154466816:12345-0@lo:400:kworker.0 Request processed in 27us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.659071:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744332.659096:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465792 00000100:00100000:2.0:1788744332.659100:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465792 00000100:00100000:2.0:1788744332.659135:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465536 00000100:00100000:2.0:1788744332.659138:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465536 00000100:00100000:2.0:1788744332.659153:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744332.659161:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154465792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659202:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154465792:12345-0@lo:400:kworker.0 Request processed in 42us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.659220:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744332.659233:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744332.659238:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154465536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659272:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154465536:12345-0@lo:400:kworker.0 Request processed in 34us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744332.659278:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788744332.659333:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744332.659338:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744332.659341:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744332.659343:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744332.659389:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154465536:0@lo:400:kworker.0 00010000:00080000:2.0:1788744332.659428:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e0000 x1875634154466048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744332.659439:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154466048:0@lo:400:kworker.0 00010000:00080000:2.0:1788744332.659452:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e2d80 x1875634154466560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744332.659460:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154466560:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659472:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154465408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659482:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154465920:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659493:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154466432:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154465792:0@lo:400:kworker.0 00010000:00080000:2.0:1788744332.659551:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e0e00 x1875634154466304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744332.659567:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154466304:0@lo:400:kworker.0 00010000:00080000:2.0:1788744332.659581:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e3480 x1875634154466816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744332.659590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154466816:0@lo:400:kworker.0 00000100:00100000:2.0:1788744332.659605:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154465664:0@lo:400:kworker.0 00010000:00080000:2.0:1788744332.659624:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e1880 x1875634154466176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744332.659633:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154466176:0@lo:400:kworker.0 00010000:00080000:2.0:1788744332.659654:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e3100 x1875634154466688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744332.659665:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154466688:0@lo:400:kworker.0 00000100:00100000:3.0:1788744332.662341:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744332.662516:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154465280 00000100:00100000:1.0:1788744332.662541:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154465280 00000100:00100000:1.0:1788744332.662633:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788744332.662643:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744332.662707:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154465280:12345-0@lo:400:kworker.0 Request processed in 66us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744332.662714:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788744332.662761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154465280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744333.167430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154466944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744333.167529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744333.168705:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154466944 00000100:00100000:0.0:1788744333.168719:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154466944 00000100:00100000:0.0:1788744333.168784:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744333.168796:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154466944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744333.168844:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744333.168943:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154466944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744333.168951:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788744333.169139:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce7b80 x1875634154466944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744333.169172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154466944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744333.169534:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154467072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744333.169607:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744333.169769:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467072 00000100:00100000:1.0:1788744333.169776:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467072 00000100:00100000:1.0:1788744333.169813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744333.169821:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154467072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744333.169839:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744333.169917:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154467072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744333.169923:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788744333.174757:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77ccbea00 x1875634154467072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744333.174785:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154467072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744333.678753:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744333.678779:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154467200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744333.678851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744333.678957:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467200 00000100:00100000:3.0:1788744333.678965:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467200 00010000:00010000:0.0:1788744333.680142:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744333.680181:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788744333.680199:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154467200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744333.680234:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744333.680313:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154467200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744333.680321:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1788744333.680701:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9dc00 x1875634154467200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744333.680722:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154467200:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788744334.071175:0:12598:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744334.071732:0:12598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788744334.190559:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744334.190622:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154467328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744334.190687:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744334.192708:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467328 00000100:00100000:1.0:1788744334.192721:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467328 00000100:00100000:1.0:1788744334.192801:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744334.192812:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154467328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744334.192836:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744334.192918:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154467328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744334.192926:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788744334.193323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744334.193369:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77ccbea00 x1875634154467328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744334.193423:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154467328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744334.350287:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744334.350374:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744334.350498:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660736 00000100:00100000:2.0:1788744334.350510:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660736 00000100:00100000:2.0:1788744334.350641:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660992 00000100:00100000:2.0:1788744334.350645:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660992 00000100:00100000:3.0:1788744334.350704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744334.350747:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744334.350770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744334.350790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744334.350816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744334.350838:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660608 00000100:00100000:3.0:1788744334.350842:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660608 00000100:00100000:3.0:1788744334.350874:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 308 00000100:00100000:3.0:1788744334.350884:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138660608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744334.350964:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138660608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744334.350984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 308 00000100:00100000:3.0:1788744334.351128:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138660864 00000100:00100000:3.0:1788744334.351132:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138660864 00000100:00100000:0.0:1788744334.356131:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661120 00000100:00100000:0.0:1788744334.356146:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661120 00000100:00080000:1.0:1788744334.357926:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788744334.357937:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744334.357996:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661248 00000100:00100000:1.0:1788744334.358007:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661248 00000100:00100000:1.0:1788744334.358081:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661376 00000100:00100000:1.0:1788744334.358085:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661376 00000100:00100000:1.0:1788744334.358114:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1788744334.358124:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138661248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744334.358211:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138661248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (7506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744334.358220:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1788744334.358237:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1788744334.358244:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138661376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744334.358266:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138661376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (7451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744334.358273:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1788744334.358293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:1.0:1788744334.358301:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138660736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744334.358329:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138660736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (8053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744334.358368:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00080000:1.0:1788744334.360507:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744334.360518:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744334.361076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:1.0:1788744334.361091:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744334.361169:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138660992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (10794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744334.361176:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:3.0:1788744334.361962:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1788744334.361973:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138660864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744334.362022:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138660864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (11250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744334.362029:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:0.0:1788744334.363481:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:0.0:1788744334.363492:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138661120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744334.363575:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138661120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 84us (12782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744334.363583:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00010000:00010000:0.0:1788744334.702544:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744335.214579:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744335.214603:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154467456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744335.214727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744335.214793:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467456 00000100:00100000:2.0:1788744335.214800:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467456 00000100:00100000:2.0:1788744335.214846:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744335.214856:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154467456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744335.214902:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744335.214965:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154467456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744335.214973:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744335.215022:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154467456:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788744335.726632:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788744336.218954:0:12695:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744336.219226:0:12695:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788744336.245314:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154467584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744336.245389:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744336.246821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467584 00000100:00100000:1.0:1788744336.246835:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467584 00000100:00100000:1.0:1788744336.246910:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788744336.246920:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154467584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744336.246953:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788744336.253967:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154467584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7039us (8567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744336.253983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744336.256010:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154467584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744336.755764:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744337.775678:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154467712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.775746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744337.775837:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467712 00000100:00100000:3.0:1788744337.775845:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467712 00000100:00100000:3.0:1788744337.775892:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788744337.775901:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154467712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.776060:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154467840:0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.776104:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744337.776179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467840 00000100:00100000:0.0:1788744337.776184:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467840 00000100:00100000:0.0:1788744337.776213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744337.776230:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154467840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.776266:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154467840:12345-0@lo:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744337.776274:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00010000:0.0:1788744337.776294:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744337.776341:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154467840:0@lo:400:kworker.0 00000100:00100000:3.0:1788744337.777772:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154467712:12345-0@lo:400:kworker.0 Request processed in 1865us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744337.777783:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788744337.778037:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154468352:0@lo:400:kworker.0 00000100:00100000:3.0:1788744337.778091:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154468096:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.778197:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154467712:0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.778226:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154467968:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.778233:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154468224:0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.778281:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744337.778301:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154468864:0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.778342:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744337.778372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468352 00000100:00100000:1.0:1788744337.778379:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468352 00000100:00100000:1.0:1788744337.778447:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468864 00000100:00100000:1.0:1788744337.778450:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468864 00000100:00100000:1.0:1788744337.778478:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788744337.778485:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154468352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.778531:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154468352:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.778538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788744337.778551:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788744337.778560:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154468864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.778584:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154468864:12345-0@lo:400:kworker.0 Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.778592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788744337.778608:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744337.778629:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154468352:0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.778636:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154468864:0@lo:400:kworker.0 00000100:00100000:3.0:1788744337.778769:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744337.778925:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744337.778942:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154468608:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.778957:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154468736:0@lo:400:kworker.0 00000100:00100000:3.0:1788744337.778968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744337.778985:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154469120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.778986:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744337.779001:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154469248:0@lo:400:kworker.0 00000100:00100000:3.0:1788744337.779004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744337.779018:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744337.779040:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744337.779055:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468224 00000100:00100000:2.0:1788744337.779057:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.779060:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468224 00000100:00100000:0.0:1788744337.779095:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154467968 00000100:00100000:0.0:1788744337.779098:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154467968 00000100:00100000:0.0:1788744337.779112:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744337.779130:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154468224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.779169:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154468224:12345-0@lo:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744337.779170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744337.779175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744337.779191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788744337.779196:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154467968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744337.779221:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154467968:12345-0@lo:400:kworker.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744337.779226:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788744337.779431:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154468992:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.779455:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744337.779487:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468096 00000100:00100000:1.0:1788744337.779491:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468096 00000100:00100000:1.0:1788744337.779514:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468480 00000100:00100000:1.0:1788744337.779517:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468480 00000100:00100000:1.0:1788744337.779538:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788744337.779544:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154468096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.779579:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154468096:12345-0@lo:400:kworker.0 Request processed in 35us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.779585:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788744337.779597:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788744337.779603:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154468480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.779630:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154468480:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.779643:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788744337.779661:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468608 00000100:00100000:1.0:1788744337.779664:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468608 00000100:00100000:1.0:1788744337.779682:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468736 00000100:00100000:1.0:1788744337.779684:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468736 00000100:00100000:1.0:1788744337.779693:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469120 00000100:00100000:1.0:1788744337.779696:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469120 00000100:00100000:1.0:1788744337.779706:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469248 00000100:00100000:1.0:1788744337.779708:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469248 00000100:00100000:1.0:1788744337.779719:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744337.779725:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154468608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.779757:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154468608:12345-0@lo:400:kworker.0 Request processed in 32us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.779763:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744337.779773:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788744337.779778:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154468736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.779882:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154468736:12345-0@lo:400:kworker.0 Request processed in 103us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.779888:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788744337.779899:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744337.779905:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154469120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.779929:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154469120:12345-0@lo:400:kworker.0 Request processed in 25us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.779935:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744337.779945:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744337.779950:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154469248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.779984:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154469248:12345-0@lo:400:kworker.0 Request processed in 34us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.779990:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788744337.780023:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744337.780027:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744337.780029:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744337.780093:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154468096:0@lo:400:kworker.0 00010000:00080000:3.0:1788744337.780227:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb6300 x1875634154468608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744337.780239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154468608:0@lo:400:kworker.0 00010000:00080000:3.0:1788744337.780253:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1c00 x1875634154469120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744337.780261:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154469120:0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.780388:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154468992 00000100:00100000:2.0:1788744337.780393:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154467968:0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.780393:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154468992 00000100:00100000:1.0:1788744337.780446:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788744337.780452:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154468992:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788744337.780453:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4700 x1875634154468480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744337.780462:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154468480:0@lo:400:kworker.0 00000100:00100000:1.0:1788744337.780481:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154468992:12345-0@lo:400:kworker.0 Request processed in 30us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.780488:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788744337.780650:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788744337.780784:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f0700 x1875634154468992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744337.780869:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154468992:0@lo:400:kworker.0 00000100:00100000:2.0:1788744337.780897:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154468224:0@lo:400:kworker.0 00010000:00080000:2.0:1788744337.780908:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7100 x1875634154468736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744337.780916:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154468736:0@lo:400:kworker.0 00010000:00080000:2.0:1788744337.780927:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f3b80 x1875634154469248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744337.780933:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154469248:0@lo:400:kworker.0 00000020:00000004:2.0:1788744338.033860:0:12792:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744338.034275:0:12792:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788744338.286649:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154469376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744338.286720:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744338.286844:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469376 00000100:00100000:2.0:1788744338.286853:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469376 00000100:00100000:2.0:1788744338.286914:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744338.286923:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154469376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744338.286951:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744338.286992:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154469376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744338.286998:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788744338.287079:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77ccbfb80 x1875634154469376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744338.287097:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154469376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744338.287444:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154469504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744338.287471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744338.292412:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469504 00000100:00100000:2.0:1788744338.292427:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469504 00000100:00100000:2.0:1788744338.292505:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788744338.292516:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154469504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744338.292543:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744338.292635:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154469504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744338.292642:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788744338.292763:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ce7100 x1875634154469504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744338.292783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154469504:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788744338.803843:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744338.804551:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154469632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744338.804617:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744338.813341:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469632 00000100:00100000:0.0:1788744338.813356:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469632 00000100:00100000:0.0:1788744338.813441:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744338.813451:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154469632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744338.813484:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744338.813560:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154469632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (8942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744338.813567:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788744338.813609:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad7b80 x1875634154469632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744338.813631:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154469632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744339.310703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744339.310770:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744339.310879:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469760 00000100:00100000:2.0:1788744339.310887:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469760 00000100:00100000:2.0:1788744339.310947:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744339.310966:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154469760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744339.310989:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744339.311042:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154469760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744339.311049:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788744339.311112:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788744339.311149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77ccbfb80 x1875634154469760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744339.311169:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744339.468738:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744339.469938:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661504 00000100:00100000:0.0:1788744339.469951:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661504 00000100:00100000:0.0:1788744339.470077:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 310 00000100:00100000:0.0:1788744339.470088:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138661504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744339.470164:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138661504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.470172:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 310 00000100:00100000:0.0:1788744339.483067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744339.483118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744339.483156:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744339.483180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661632 00000100:00100000:0.0:1788744339.483197:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744339.483200:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661632 00000100:00100000:0.0:1788744339.483235:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744339.483293:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744339.483300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661888 00000100:00100000:1.0:1788744339.483315:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661888 00000100:00100000:0.0:1788744339.483349:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138661760 00000100:00100000:1.0:1788744339.483361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662016 00000100:00100000:0.0:1788744339.483362:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138661760 00000100:00100000:1.0:1788744339.483372:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662016 00000100:00100000:1.0:1788744339.483461:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:1.0:1788744339.483495:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138661632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744339.483619:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138661632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 129us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.483801:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:0.0:1788744339.483816:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138661888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744339.484120:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138661888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 307us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.484130:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:0.0:1788744339.484151:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:0.0:1788744339.484160:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138662016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744339.484190:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138662016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.484196:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:0.0:1788744339.484209:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:0.0:1788744339.484216:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138661760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744339.484242:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138661760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.484249:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:0.0:1788744339.484801:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662144 00000100:00100000:0.0:1788744339.484811:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662144 00000100:00100000:0.0:1788744339.485095:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662272 00000100:00100000:0.0:1788744339.485101:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662272 00000100:00100000:0.0:1788744339.485145:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1788744339.485160:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2393:x1875634138662144:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:0.0:1788744339.485185:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc294 00000100:00080000:0.0:1788744339.485194:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac77cb31800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744339.485248:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788744339.485755:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+2:2393:x1875634138662144:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 600us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.485764:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1788744339.485791:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788744339.485801:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2393:x1875634138662272:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:0.0:1788744339.485816:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc29b 00000100:00080000:0.0:1788744339.485823:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac77cb33800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744339.485857:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788744339.486239:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+2:2393:x1875634138662272:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 439us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.486246:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00010000:00010000:0.0:1788744339.486694:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744339.486702:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744339.489549:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00080000:3.0:1788744339.490023:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744339.490032:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744339.490036:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744339.490038:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788744339.834724:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788744340.193129:0:12890:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744340.195519:0:12890:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788744340.334763:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154469888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744340.334860:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744340.334986:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154469888 00000100:00100000:2.0:1788744340.334997:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154469888 00000100:00100000:2.0:1788744340.335061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788744340.335072:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154469888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744340.335126:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744340.335361:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154469888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 283us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744340.335375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788744340.335466:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154469888:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744340.847875:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744341.364285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154470016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744341.364393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744341.364572:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470016 00000100:00100000:1.0:1788744341.364584:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470016 00000100:00100000:1.0:1788744341.364644:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788744341.364654:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154470016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744341.364698:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788744341.364760:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154470016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744341.364768:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788744341.364827:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154470016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744341.871143:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744342.896990:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744342.897268:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154470272:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897384:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744342.897463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154470784:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897487:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744342.897512:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154471296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897533:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744342.897578:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744342.897586:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154470400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897622:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744342.897641:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154470912:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897662:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744342.897679:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154471424:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897697:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744342.897746:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470272 00000100:00100000:2.0:1788744342.897754:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470272 00000100:00100000:2.0:1788744342.897788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470784 00000100:00100000:2.0:1788744342.897791:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470784 00000100:00100000:2.0:1788744342.897814:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471296 00000100:00100000:2.0:1788744342.897818:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471296 00000100:00100000:2.0:1788744342.897831:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470912 00000100:00100000:2.0:1788744342.897834:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470912 00000100:00100000:2.0:1788744342.897845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471424 00000100:00100000:2.0:1788744342.897847:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471424 00000100:00100000:2.0:1788744342.897862:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744342.897871:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154470272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897921:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154470272:12345-0@lo:400:kworker.0 Request processed in 51us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.897929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744342.897946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788744342.897952:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154470784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.897979:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154470784:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.897984:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788744342.897995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788744342.898001:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154471296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898027:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154471296:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.898032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788744342.898044:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788744342.898050:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154470912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898078:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154470912:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.898090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788744342.898103:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788744342.898109:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898135:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154471424:12345-0@lo:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.898141:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788744342.898167:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470400 00000100:00100000:2.0:1788744342.898171:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470400 00000100:00100000:2.0:1788744342.898197:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788744342.898203:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154470400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898235:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154470400:12345-0@lo:400:kworker.0 Request processed in 33us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.898241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788744342.898261:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744342.898264:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744342.898306:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154470400:0@lo:400:kworker.0 00010000:00080000:2.0:1788744342.898320:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7b80 x1875634154470912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744342.898329:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154470912:0@lo:400:kworker.0 00010000:00080000:2.0:1788744342.898336:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e2a00 x1875634154471424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744342.898344:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154471424:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154470272:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154470784:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.898379:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154471296:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898499:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154470144:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898557:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154470656:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898595:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154471168:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898634:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898672:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788744342.898678:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154470528:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898711:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154471040:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898729:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898754:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154471552:0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898776:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744342.898803:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471168 00000100:00100000:0.0:1788744342.898807:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471168 00000100:00100000:0.0:1788744342.898834:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471680 00000100:00100000:0.0:1788744342.898837:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471680 00000100:00100000:0.0:1788744342.898848:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471040 00000100:00100000:0.0:1788744342.898851:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471040 00000100:00100000:0.0:1788744342.898863:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471552 00000100:00100000:0.0:1788744342.898865:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471552 00000100:00100000:0.0:1788744342.898878:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788744342.898885:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154471168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898921:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154471168:12345-0@lo:400:kworker.0 Request processed in 36us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.898928:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788744342.898941:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788744342.898947:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.898973:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154471680:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.898979:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788744342.898989:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788744342.898995:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.899020:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154471040:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.899026:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788744342.899037:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788744342.899043:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744342.899079:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154471552:12345-0@lo:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.899085:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788744342.899120:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5500 x1875634154471040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744342.899130:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154471040:0@lo:400:kworker.0 00010000:00080000:0.0:1788744342.899140:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e3100 x1875634154471552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744342.899147:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154471552:0@lo:400:kworker.0 00010000:00080000:0.0:1788744342.899156:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7480 x1875634154471168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744342.899164:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154471168:0@lo:400:kworker.0 00010000:00080000:0.0:1788744342.899173:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e1880 x1875634154471680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744342.899180:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154471680:0@lo:400:kworker.0 00000100:00100000:1.0:1788744342.899271:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470528 00000100:00100000:1.0:1788744342.899276:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470528 00000100:00100000:1.0:1788744342.899321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788744342.899328:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154470528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744342.899367:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154470528:12345-0@lo:400:kworker.0 Request processed in 40us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744342.899373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788744342.899424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470656 00000100:00100000:1.0:1788744342.899428:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470656 00000100:00100000:1.0:1788744342.899463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788744342.899469:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154470656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744342.899501:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154470656:12345-0@lo:400:kworker.0 Request processed in 33us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744342.899507:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788744342.899536:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154470528:0@lo:400:kworker.0 00000100:00100000:1.0:1788744342.899545:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154470656:0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.899664:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154470144 00000100:00100000:2.0:1788744342.899669:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154470144 00000100:00100000:2.0:1788744342.899799:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788744342.899807:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154470144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744342.899852:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154470144:12345-0@lo:400:kworker.0 Request processed in 47us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.899858:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788744342.899912:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154470144:0@lo:400:kworker.0 00000100:00080000:3.0:1788744342.905504:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744342.905513:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744343.406760:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154471936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744343.406760:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154471808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744343.410570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744343.410612:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471808 00000100:00100000:1.0:1788744343.410620:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471808 00000100:00100000:1.0:1788744343.410805:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744343.410816:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154471808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744343.410860:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744343.410918:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154471808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744343.410925:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788744343.410964:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1c00 x1875634154471808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744343.410982:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154471808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744343.417800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744343.417928:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154471936 00000100:00100000:2.0:1788744343.417939:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154471936 00000100:00100000:2.0:1788744343.417995:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744343.418006:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154471936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744343.418035:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744343.418092:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154471936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.418099:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788744343.418220:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad5180 x1875634154471936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744343.418240:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154471936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744343.919695:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744343.919720:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154472064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744343.919785:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744343.919934:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744343.919954:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472064 00000100:00100000:1.0:1788744343.919962:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472064 00000100:00100000:1.0:1788744343.920009:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788744343.920019:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154472064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744343.920049:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744343.920091:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154472064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744343.920098:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1788744343.920337:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b7b100 x1875634154472064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744343.920355:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154472064:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788744344.169371:0:13034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788744344.431568:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154472192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744344.431637:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744344.432084:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472192 00000100:00100000:2.0:1788744344.432093:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472192 00000100:00100000:2.0:1788744344.432157:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744344.432168:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154472192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744344.432191:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744344.432241:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154472192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744344.432248:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788744344.432369:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744344.433471:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e2a00 x1875634154472192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744344.433503:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154472192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744344.591531:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744344.591919:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744344.591948:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744344.591983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744344.592009:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744344.592035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662656 00000100:00100000:3.0:1788744344.592043:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662656 00000100:00100000:1.0:1788744344.592213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662912 00000100:00100000:1.0:1788744344.592218:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662912 00000100:00100000:1.0:1788744344.592257:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662528 00000100:00100000:1.0:1788744344.592260:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662528 00000100:00100000:1.0:1788744344.592285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662784 00000100:00100000:1.0:1788744344.592288:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662784 00000100:00100000:1.0:1788744344.592304:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:1.0:1788744344.592313:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138662912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744344.592387:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138662912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.592395:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:1.0:1788744344.592441:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:1.0:1788744344.592461:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138662528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744344.592489:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138662528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.592495:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:1.0:1788744344.592508:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:1.0:1788744344.592515:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138662784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744344.592537:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138662784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.592542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00080000:2.0:1788744344.593029:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744344.593041:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744344.593317:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:2.0:1788744344.593328:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138662656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744344.593384:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138662656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744344.593391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:0.0:1788744344.597973:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138662400 00000100:00100000:0.0:1788744344.597990:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138662400 00000100:00100000:1.0:1788744344.600626:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 312 00000100:00100000:1.0:1788744344.600641:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138662400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744344.600744:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138662400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 105us (9221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.600751:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 312 00010000:00010000:2.0:1788744344.943671:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744345.459260:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744345.459292:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154472320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744345.459356:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.459436:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472320 00000100:00100000:2.0:1788744345.459444:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472320 00000100:00100000:2.0:1788744345.459489:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788744345.459498:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154472320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744345.459530:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744345.462826:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154472320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3319us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.462840:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744345.462956:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154472320:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788744345.468769:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000020:00000080:3.0:1788744345.468778:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ac77cb36800/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000020:00000080:2.0:1788744345.468886:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77cb36800/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 for lustre-OST0000 00000020:00000080:2.0:1788744345.468939:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77cb31800 for lustre-OST0000 00000001:00100000:2.0:1788744345.469791:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000020:00000080:2.0:1788744345.469796:0:9507:0:(genops.c:885:class_export_put()) final put ffff9ac77cb31000/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000020:00000080:3.0:1788744345.470133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77cb31000/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 for lustre-OST0001 00000020:00000080:3.0:1788744345.470171:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77cb33800 for lustre-OST0001 00010000:00010000:3.0:1788744345.966590:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744346.480243:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154472448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744346.480317:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744346.480540:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472448 00000100:00100000:2.0:1788744346.480548:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472448 00000100:00100000:2.0:1788744346.480597:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788744346.480606:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154472448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744346.480648:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788744346.483215:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154472448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2604us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744346.483229:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788744346.483345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154472448:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744346.993809:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744348.015669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154472832:0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.015732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.015774:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.015796:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.015829:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.015851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.015875:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744348.015881:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154472960:0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.015900:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.015921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154473472:0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.015945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.015964:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.015982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.016011:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472832 00000100:00100000:2.0:1788744348.016018:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472832 00000100:00100000:2.0:1788744348.016078:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788744348.016087:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154472832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.016142:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154472832:12345-0@lo:400:kworker.0 Request processed in 55us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.016149:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788744348.016173:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473344 00000100:00100000:2.0:1788744348.016176:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473344 00000100:00100000:2.0:1788744348.016206:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473856 00000100:00100000:2.0:1788744348.016218:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473856 00000100:00100000:2.0:1788744348.016243:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472960 00000100:00100000:2.0:1788744348.016246:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472960 00000100:00100000:2.0:1788744348.016278:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788744348.016284:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154473344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.016668:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154473344:12345-0@lo:400:kworker.0 Request processed in 383us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.016675:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788744348.016691:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788744348.016697:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.016729:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154473856:12345-0@lo:400:kworker.0 Request processed in 33us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.016734:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788744348.016746:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788744348.016752:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154472960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744348.016777:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154472960:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.016781:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788744348.016920:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154472576:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.016958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.016988:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154473088:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017012:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.017032:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154473600:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017069:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.017089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154474112:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017122:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.017143:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788744348.017149:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.017190:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.017227:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154473728:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744348.017335:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473088 00000100:00100000:3.0:1788744348.017341:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473088 00000100:00100000:3.0:1788744348.017374:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744348.017380:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154473088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017436:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154473088:12345-0@lo:400:kworker.0 Request processed in 56us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017443:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744348.017462:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473472 00000100:00100000:3.0:1788744348.017466:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473472 00000100:00100000:3.0:1788744348.017487:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473984 00000100:00100000:3.0:1788744348.017489:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473984 00000100:00100000:3.0:1788744348.017501:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473600 00000100:00100000:3.0:1788744348.017503:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473600 00000100:00100000:3.0:1788744348.017514:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154474112 00000100:00100000:3.0:1788744348.017516:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154474112 00000100:00100000:3.0:1788744348.017526:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788744348.017532:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154473472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017574:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154473472:12345-0@lo:400:kworker.0 Request processed in 42us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017579:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788744348.017608:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788744348.017614:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154473984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017642:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154473984:12345-0@lo:400:kworker.0 Request processed in 29us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017648:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788744348.017659:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788744348.017664:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154473600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017690:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154473600:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017696:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788744348.017707:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788744348.017713:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154474112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017736:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154474112:12345-0@lo:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017742:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788744348.017762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472704 00000100:00100000:3.0:1788744348.017766:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472704 00000100:00100000:3.0:1788744348.017780:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473216 00000100:00100000:3.0:1788744348.017782:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473216 00000100:00100000:3.0:1788744348.017793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154473728 00000100:00100000:3.0:1788744348.017796:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154473728 00000100:00100000:3.0:1788744348.017820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788744348.017826:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017854:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154472704:12345-0@lo:400:kworker.0 Request processed in 29us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017860:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788744348.017871:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788744348.017886:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154473216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017913:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154473216:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788744348.017928:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788744348.017933:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154473728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.017955:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154473728:12345-0@lo:400:kworker.0 Request processed in 22us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.017960:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788744348.018000:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.018010:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.018017:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154473728:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.018026:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154473088:0@lo:400:kworker.0 00010000:00080000:3.0:1788744348.018036:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7480 x1875634154473600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744348.018046:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154473600:0@lo:400:kworker.0 00010000:00080000:3.0:1788744348.018054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7100 x1875634154474112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744348.018061:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154474112:0@lo:400:kworker.0 00000100:00080000:3.0:1788744348.018117:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744348.018122:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744348.018124:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744348.018126:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744348.018163:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154472960:0@lo:400:kworker.0 00010000:00080000:3.0:1788744348.018175:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4700 x1875634154473472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744348.018184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154473472:0@lo:400:kworker.0 00010000:00080000:3.0:1788744348.018194:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb6300 x1875634154473984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744348.018216:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154473984:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.018230:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154472832:0@lo:400:kworker.0 00010000:00080000:3.0:1788744348.018240:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4e00 x1875634154473344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744348.018258:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154473344:0@lo:400:kworker.0 00010000:00080000:3.0:1788744348.018270:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb6680 x1875634154473856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744348.018278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154473856:0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.018324:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154472576 00000100:00100000:3.0:1788744348.018329:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154472576 00000100:00100000:3.0:1788744348.018356:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788744348.018362:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744348.018399:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154472576:12345-0@lo:400:kworker.0 Request processed in 37us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744348.018430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788744348.018466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154472576:0@lo:400:kworker.0 00010000:00010000:2.0:1788744348.020154:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788744348.022356:0:13182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec497fa80 20000000:00000080:1.0:1788744348.022373:0:13182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac643235000 uarg=0000000000000000 20000000:01000000:1.0:1788744348.022441:0:13182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744348.022446:0:13182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744348.022451:0:13182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788744348.023333:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788744348.023580:0:13182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788744348.033387:0:13182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788744348.033970:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.033989:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.033998:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034005:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034012:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034022:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034030:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034037:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034089:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034106:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 12 pid: 6511 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.034132:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474240:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744348.034225:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034233:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.034242:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744348.034281:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034289:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 23 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.034297:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474496:0@lo:104: 00000100:00100000:0.0:1788744348.034333:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744348.034372:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034380:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 23 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.034388:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474624:0@lo:104: 00000100:00100000:0.0:1788744348.034429:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744348.034462:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034470:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 23 pid: 6511 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.034488:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474752:0@lo:104: 00000100:00100000:0.0:1788744348.034509:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744348.034525:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744348.034532:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 23 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.034539:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474880:0@lo:104: 00000100:00100000:0.0:1788744348.034557:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744348.034566:0:13182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643c1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744348.034646:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154474496 00000100:00100000:2.0:1788744348.034653:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154474496 00000100:00100000:2.0:1788744348.034689:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154474624 00000100:00100000:2.0:1788744348.034692:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154474624 00000100:00100000:2.0:1788744348.034701:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154474752 00000100:00100000:2.0:1788744348.034704:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154474752 00000100:00100000:2.0:1788744348.034711:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154474880 00000100:00100000:2.0:1788744348.034713:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154474880 00000100:00100000:2.0:1788744348.034725:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788744348.034733:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:13182:x1875634154474496:12345-0@lo:104: 00010000:00010000:2.0:1788744348.034751:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.034810:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744348.034816:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+6:13182:x1875634154474496:12345-0@lo:104: Request processed in 84us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.034823:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788744348.034841:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744348.034846:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:13182:x1875634154474624:12345-0@lo:104: 00010000:00010000:2.0:1788744348.034853:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.034884:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744348.034889:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+5:13182:x1875634154474624:12345-0@lo:104: Request processed in 44us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.034894:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744348.034905:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744348.034911:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:13182:x1875634154474752:12345-0@lo:104: 00010000:00010000:2.0:1788744348.034918:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.034947:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788744348.034951:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+4:13182:x1875634154474752:12345-0@lo:104: Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.034957:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744348.034968:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744348.034973:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:13182:x1875634154474880:12345-0@lo:104: 00010000:00010000:2.0:1788744348.034988:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035017:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788744348.035023:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+3:13182:x1875634154474880:12345-0@lo:104: Request processed in 50us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.035029:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788744348.035045:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788744348.035051:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035058:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c4200 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744348.035063:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035070:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744348.035078:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744348.035083:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744348.035110:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035118:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744348.035137:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035144:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4200/0xb6207a6e76dcc25c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc263 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035163:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744348.035166:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035171:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c5c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744348.035174:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035180:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744348.035186:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744348.035190:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744348.035203:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035207:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744348.035221:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035228:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5c00/0xb6207a6e76dcc24e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc255 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035236:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744348.035239:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035275:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061ae00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744348.035278:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035294:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744348.035300:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744348.035305:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744348.035318:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035324:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744348.035329:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035336:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061ae00/0xb6207a6e76dcc240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035344:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744348.035346:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035352:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82a00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744348.035355:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035371:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744348.035376:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744348.035381:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744348.035394:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035426:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744348.035434:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035440:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac775b82a00/0xb6207a6e76dcc232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035453:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744348.035455:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744348.035456:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744348.035463:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744348.035469:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744348.035486:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154475008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.035517:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.035545:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744348.035551:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154475392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.035572:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.035597:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475008 00000100:00100000:2.0:1788744348.035608:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475008 00010000:00010000:2.0:1788744348.035626:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 24 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.035645:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475392 00000100:00100000:2.0:1788744348.035648:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475392 00010000:00010000:2.0:1788744348.035657:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 25 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.035674:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744348.035680:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3644:x1875634154475008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744348.035690:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744348.035694:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 25 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035703:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 25 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035716:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744348.035744:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3644:x1875634154475008:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.035750:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744348.035763:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744348.035768:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154475392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744348.035775:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744348.035779:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 24 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035787:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 24 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.035807:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744348.035829:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154475392:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.035835:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744348.035862:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154475264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.035885:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.035903:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744348.035909:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154475136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.035928:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.035950:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475264 00000100:00100000:2.0:1788744348.035953:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475264 00010000:00010000:2.0:1788744348.035966:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 24 pid: 6511 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.035983:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475136 00000100:00100000:2.0:1788744348.035986:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475136 00010000:00010000:2.0:1788744348.035996:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 25 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.036013:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744348.036019:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3646:x1875634154475264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744348.036026:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744348.036030:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 25 pid: 6511 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.036037:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 25 pid: 6511 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.036058:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744348.036086:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3646:x1875634154475264:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.036092:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744348.036105:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744348.036111:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154475136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744348.036118:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744348.036123:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 24 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.036131:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 24 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.036140:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744348.036160:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154475136:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.036165:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744348.036198:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154475136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.036206:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154475264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.036230:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154475392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744348.036236:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154475008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744348.036738:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061b600/0xb6207a6e76dcc263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc25c expref: 23 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.036753:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474496:0@lo:104: 00010000:00010000:0.0:1788744348.036763:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031000/0xb6207a6e76dcc255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc24e expref: 22 pid: 6510 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.036771:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474624:0@lo:104: 00010000:00010000:0.0:1788744348.036780:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4a00/0xb6207a6e76dcc247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc240 expref: 21 pid: 6511 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.036788:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474752:0@lo:104: 00010000:00010000:0.0:1788744348.036797:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c5a00/0xb6207a6e76dcc239 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc232 expref: 20 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.036805:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474880:0@lo:104: 00000100:00100000:3.0:1788744348.039892:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744348.039995:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474240:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744348.040007:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875634154474368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744348.040037:0:13182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.040094:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663040 00000100:00100000:2.0:1788744348.040102:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663040 00010000:00010000:2.0:1788744348.040134:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 13 pid: 6511 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.040191:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788744348.040200:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138663040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744348.040215:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744348.040221:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 13 pid: 6511 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.040232:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 13 pid: 6511 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.040258:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac782170a00/0xb6207a6e76dcc27f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d385 expref: 13 pid: 6511 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.040274:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744348.040339:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:2395:x1875634138663040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.040347:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788744348.047217:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744348.047304:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663168 00000100:00100000:2.0:1788744348.047325:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663168 00010000:00010000:2.0:1788744348.047365:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744348.047450:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:2.0:1788744348.047461:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:2394:x1875634138663168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744348.047477:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744348.047483:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047513:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047533:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcc26a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d346 expref: 12 pid: 6509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047550:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047557:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047585:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047592:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047607:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047613:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047619:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744348.047623:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047632:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047661:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744348.047671:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744348.047718:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:2394:x1875634138663168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 258us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.047726:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00010000:00010000:1.0:1788744348.048181:0:13182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744348.048191:0:13182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744348.048205:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740030c00/0xb6207a6e76dcc2a2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744348.527191:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154475520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744348.527322:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744348.527337:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154475648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744348.532943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744348.532986:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475520 00000100:00100000:2.0:1788744348.532996:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475520 00000100:00100000:2.0:1788744348.533061:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744348.533071:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154475520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744348.533095:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788744348.533112:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744348.533150:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154475520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.533157:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744348.533172:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475648 00000100:00100000:2.0:1788744348.533175:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475648 00000100:00100000:2.0:1788744348.533194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788744348.533197:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac775a25c00 x1875634154475520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744348.533199:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154475648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744348.533208:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744348.533215:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154475520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744348.533304:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154475648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744348.533311:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788744348.533318:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77aaa7b80 x1875634154475648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744348.533560:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154475648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744349.038960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154475776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744349.039026:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744349.039444:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744349.040645:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475776 00000100:00100000:0.0:1788744349.040657:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475776 00000100:00100000:0.0:1788744349.040765:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744349.040776:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154475776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744349.040816:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744349.040893:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154475776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.040900:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1788744349.040959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6424c2300 x1875634154475776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744349.040980:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154475776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744349.261369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744349.261636:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663296 00000100:00100000:2.0:1788744349.261646:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663296 00000100:00100000:2.0:1788744349.261706:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:2.0:1788744349.261717:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:6165:x1875634138663296:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744349.261734:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744349.261754:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.261784:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.261796:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.261806:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83800, rc 0) 00000100:00100000:2.0:1788744349.261869:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138663296:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 154us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.261877:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:2.0:1788744349.270643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744349.270741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663424 00000100:00100000:3.0:1788744349.270752:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663424 00000100:00100000:3.0:1788744349.270880:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 315 00000100:00100000:3.0:1788744349.270892:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138663424:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.271048:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138663424:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 150us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.271058:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 315 00000100:00100000:1.0:1788744349.278507:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744349.278582:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663552 00000100:00100000:3.0:1788744349.278591:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663552 00000100:00100000:3.0:1788744349.278644:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 316 00000100:00100000:3.0:1788744349.278655:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138663552:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.278795:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138663552:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 141us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.278815:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 316 00000100:00100000:0.0:1788744349.297476:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744349.299844:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663680 00000100:00100000:3.0:1788744349.299862:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663680 00000100:00100000:3.0:1788744349.299947:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 317 00000100:00100000:3.0:1788744349.299958:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138663680:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744349.299976:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744349.299995:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3bd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.300056:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.300069:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.300079:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfa00, rc 0) 00000100:00100000:3.0:1788744349.300458:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138663680:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 501us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.300466:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 317 00000100:00100000:3.0:1788744349.309804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744349.309900:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663808 00000100:00100000:0.0:1788744349.309910:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663808 00000100:00100000:0.0:1788744349.309962:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 318 00000100:00100000:0.0:1788744349.309972:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138663808:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.310112:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138663808:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 141us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.310132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 318 00000100:00100000:0.0:1788744349.313166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744349.313462:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138663936 00000100:00100000:0.0:1788744349.313472:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138663936 00000100:00100000:0.0:1788744349.313515:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 319 00000100:00100000:0.0:1788744349.313524:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138663936:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.313649:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138663936:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 125us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.313657:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 319 00000100:00100000:2.0:1788744349.550912:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154475904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744349.550980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744349.551047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154475904 00000100:00100000:2.0:1788744349.551055:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154475904 00000100:00100000:2.0:1788744349.551099:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744349.551109:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154475904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744349.551130:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744349.551174:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154475904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.551192:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788744349.551234:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64372ad80 x1875634154475904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744349.551263:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154475904:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788744349.619991:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744349.619998:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac642271000 from 7 10000000:01000000:3.0:1788744349.620004:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744349.620042:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.620054:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.620065:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744349.620097:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.620162:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744349.620207:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744349.620307:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476032 00000100:00100000:2.0:1788744349.620315:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476032 00000100:00100000:2.0:1788744349.620364:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788744349.620372:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154476032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744349.620385:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744349.620396:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc2b7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.620437:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.620448:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.620457:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b83000, rc 0) 00000100:00100000:2.0:1788744349.620494:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154476032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.620501:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788744349.620542:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744349.620555:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.620575:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744349.620628:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.620651:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744349.620661:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744349.620746:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476160 00000100:00100000:3.0:1788744349.620750:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476160 00000100:00100000:3.0:1788744349.620781:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788744349.620787:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154476160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.620885:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154476160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.620891:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788744349.621006:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.621035:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.621080:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744349.621099:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744349.621222:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476288 00000100:00100000:3.0:1788744349.621226:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476288 00000100:00100000:3.0:1788744349.621259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788744349.621265:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154476288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.621328:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154476288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.621334:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788744349.621397:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744349.626778:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788744349.630645:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744349.630681:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744349.630693:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.630713:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744349.630791:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744349.630795:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac77c9d5000 from 7 10000000:01000000:0.0:1788744349.630798:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744349.630998:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.631008:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.631019:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744349.631278:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.631341:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744349.631385:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643c1d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744349.631581:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476416 00000100:00100000:3.0:1788744349.631589:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476416 00000100:00100000:3.0:1788744349.631640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788744349.631648:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154476416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744349.631661:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744349.631674:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.631695:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.631705:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.631713:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf400, rc 0) 00000100:00100000:3.0:1788744349.631755:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154476416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.631770:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788744349.631827:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744349.631840:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.631848:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744349.631908:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.631931:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744349.631948:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744349.632680:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476544 00000100:00100000:0.0:1788744349.632690:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476544 00000100:00100000:0.0:1788744349.632733:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788744349.632741:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154476544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.632970:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154476544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.632978:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788744349.633067:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.633113:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.633171:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744349.633200:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744349.633358:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476672 00000100:00100000:0.0:1788744349.633363:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476672 00000100:00100000:0.0:1788744349.633391:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788744349.633398:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154476672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.633506:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154476672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.633513:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788744349.634471:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744349.635599:0:13233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788744349.635762:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744349.635789:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744349.635809:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.635821:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744349.635830:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744349.635844:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac774b65800 from 7 10000000:01000000:0.0:1788744349.635847:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744349.635879:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.635888:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.635897:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744349.635919:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.635974:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744349.636016:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762a78c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744349.636261:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476800 00000100:00100000:2.0:1788744349.636269:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476800 00000100:00100000:2.0:1788744349.636313:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788744349.636322:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154476800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744349.636335:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744349.636348:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc2d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.636369:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.636389:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.636397:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82a00, rc 0) 00000100:00100000:2.0:1788744349.636460:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154476800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.636467:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788744349.636553:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744349.636566:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.636575:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744349.636629:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.636654:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744349.636679:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762a78c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744349.636725:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154476928 00000100:00100000:2.0:1788744349.636729:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154476928 00000100:00100000:2.0:1788744349.636757:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788744349.636763:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154476928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.636880:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154476928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.636886:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788744349.636913:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154476928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.636939:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.636980:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744349.636994:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744349.637005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477056 00000100:00100000:2.0:1788744349.637008:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477056 00000100:00100000:2.0:1788744349.637028:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788744349.637033:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154477056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744349.637296:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154477056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.637303:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788744349.637347:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744349.640376:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788744349.641282:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744349.641311:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744349.641324:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.641336:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744349.641355:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744349.641359:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75196e800 from 7 10000000:01000000:0.0:1788744349.641362:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744349.641523:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.641533:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.641543:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744349.641569:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.641633:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744349.641709:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762a78c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744349.641754:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477184 00000100:00100000:2.0:1788744349.641761:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477184 00000100:00100000:2.0:1788744349.641904:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788744349.641915:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154477184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744349.641929:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744349.641942:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.641964:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.641974:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744349.641981:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac775b82400, rc 0) 00000100:00100000:2.0:1788744349.642085:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154477184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744349.642093:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788744349.642373:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744349.642389:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744349.642397:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744349.642487:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744349.642521:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744349.642666:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac762a78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744349.642697:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477312 00000100:00100000:3.0:1788744349.642703:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477312 00000100:00100000:3.0:1788744349.642727:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788744349.642733:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154477312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.642851:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154477312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.642858:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788744349.642888:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.642918:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.642960:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744349.642973:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744349.642984:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477440 00000100:00100000:3.0:1788744349.642987:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477440 00000100:00100000:3.0:1788744349.643002:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788744349.643008:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154477440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744349.643094:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154477440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744349.643100:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788744349.643347:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154477440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744349.644820:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788744349.644953:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788744349.644976:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744349.644987:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744349.644998:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744349.707218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744349.707267:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744349.707314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744349.707344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744349.707372:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664064 00000100:00100000:0.0:1788744349.707382:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664064 00000100:00100000:0.0:1788744349.707465:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664320 00000100:00100000:0.0:1788744349.707469:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664320 00000100:00100000:0.0:1788744349.707497:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664192 00000100:00100000:0.0:1788744349.707499:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664192 00000100:00100000:0.0:1788744349.707513:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664448 00000100:00100000:0.0:1788744349.707516:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664448 00000100:00100000:0.0:1788744349.707533:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:0.0:1788744349.707542:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138664064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744349.707610:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138664064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 68us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.707617:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:0.0:1788744349.707633:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:0.0:1788744349.707641:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138664320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744349.707667:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138664320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.707673:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:0.0:1788744349.707687:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:0.0:1788744349.707694:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138664192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744349.707718:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138664192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.707725:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:0.0:1788744349.707737:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:0.0:1788744349.707745:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138664448:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744349.707776:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138664448:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744349.707782:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00080000:0.0:1788744349.707803:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744349.707816:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788744350.062655:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744350.575082:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744350.575103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154477568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744350.575166:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744350.575248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477568 00000100:00100000:3.0:1788744350.575256:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477568 00000100:00100000:3.0:1788744350.575301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788744350.575309:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154477568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744350.575340:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744350.575443:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154477568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744350.575460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788744350.575508:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154477568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788744351.086738:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744351.599322:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154477696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744351.599395:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744351.599474:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477696 00000100:00100000:0.0:1788744351.599482:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477696 00000100:00100000:0.0:1788744351.599525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788744351.599533:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154477696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744351.599566:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744351.599608:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154477696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744351.599615:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788744351.599660:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154477696:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788744352.040482:0:13380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788744352.114332:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744353.135145:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154477824:0@lo:400:kworker.0 00000100:00100000:3.0:1788744353.135350:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744353.135614:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477824 00000100:00100000:1.0:1788744353.135622:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477824 00000100:00100000:1.0:1788744353.135664:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788744353.135673:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.135771:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.135802:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.135840:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478208 00000100:00100000:2.0:1788744353.135844:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478208 00000100:00100000:2.0:1788744353.135871:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788744353.135877:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154478208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.135926:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154478208:12345-0@lo:400:kworker.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.135934:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788744353.135976:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.136029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154477952:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.136050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.136066:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744353.136071:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.136090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.136110:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154477952 00000100:00100000:2.0:1788744353.136114:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154477952 00000100:00100000:2.0:1788744353.136136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788744353.136142:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154477952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.136175:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154477952:12345-0@lo:400:kworker.0 Request processed in 33us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.136181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788744353.136203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154477952:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.136235:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478080 00000100:00100000:2.0:1788744353.136239:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478080 00000100:00100000:2.0:1788744353.136272:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788744353.136279:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154478080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.136310:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154478080:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.136316:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788744353.136340:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154478080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744353.137939:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154477824:12345-0@lo:400:kworker.0 Request processed in 2261us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744353.137951:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:2.0:1788744353.138884:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744353.138906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154478592:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.138965:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139018:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154479104:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139038:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139070:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788744353.139076:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139114:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154478976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139133:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139161:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478592 00000100:00100000:2.0:1788744353.139168:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478592 00000100:00100000:2.0:1788744353.139212:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479104 00000100:00100000:2.0:1788744353.139226:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479104 00000100:00100000:2.0:1788744353.139239:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478464 00000100:00100000:2.0:1788744353.139241:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478464 00000100:00100000:2.0:1788744353.139249:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478976 00000100:00100000:2.0:1788744353.139251:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478976 00000100:00100000:2.0:1788744353.139276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788744353.139283:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154478592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139331:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154478592:12345-0@lo:400:kworker.0 Request processed in 48us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.139338:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788744353.139352:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788744353.139356:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154479104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139377:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154479104:12345-0@lo:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.139532:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788744353.139544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788744353.139550:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139576:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154478464:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.139580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788744353.139589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788744353.139594:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139614:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154478976:12345-0@lo:400:kworker.0 Request processed in 20us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.139618:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1788744353.139631:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744353.139635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744353.139647:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154478720:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139670:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139694:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154479232:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139711:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139727:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744353.139732:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154478336:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139766:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154478848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154479360:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139808:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.139836:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478720 00000100:00100000:2.0:1788744353.139841:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478720 00000100:00100000:2.0:1788744353.139863:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479232 00000100:00100000:2.0:1788744353.139866:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479232 00000100:00100000:2.0:1788744353.139877:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478848 00000100:00100000:2.0:1788744353.139880:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478848 00000100:00100000:2.0:1788744353.139889:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479360 00000100:00100000:2.0:1788744353.139891:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479360 00000100:00100000:2.0:1788744353.139902:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744353.139908:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154478720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139941:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154478720:12345-0@lo:400:kworker.0 Request processed in 33us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.139948:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744353.139961:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744353.139967:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154479232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.139994:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154479232:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.139999:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744353.140008:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744353.140014:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.140040:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154478848:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.140045:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744353.140055:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744353.140060:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154479360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.140083:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154479360:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.140088:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744353.140127:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154478336 00000100:00100000:2.0:1788744353.140131:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154478336 00000100:00100000:2.0:1788744353.140157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788744353.140164:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154478336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.140195:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154478336:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.140200:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788744353.140232:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744353.140236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744353.140909:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154478336:0@lo:400:kworker.0 00010000:00080000:1.0:1788744353.140924:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337fb80 x1875634154478848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744353.140934:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154478848:0@lo:400:kworker.0 00010000:00080000:1.0:1788744353.140945:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b45180 x1875634154479360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744353.140969:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154479360:0@lo:400:kworker.0 00010000:00080000:1.0:1788744353.140984:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337d500 x1875634154478720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744353.141007:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154478720:0@lo:400:kworker.0 00010000:00080000:1.0:1788744353.141018:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44380 x1875634154479232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744353.141024:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154479232:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.141172:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788744353.141187:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154478976:0@lo:400:kworker.0 00010000:00080000:2.0:1788744353.141197:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337ea00 x1875634154478592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744353.141205:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154478592:0@lo:400:kworker.0 00010000:00080000:2.0:1788744353.141225:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b44000 x1875634154479104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744353.141233:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154479104:0@lo:400:kworker.0 00000100:00100000:3.0:1788744353.141903:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154477824:0@lo:400:kworker.0 00000100:00100000:0.0:1788744353.647730:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154479488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744353.648375:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744353.649346:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744353.649360:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154479616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744353.649426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744353.653135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479488 00000100:00100000:2.0:1788744353.653155:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479488 00000100:00100000:2.0:1788744353.653234:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479616 00000100:00100000:2.0:1788744353.653238:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479616 00000100:00100000:2.0:1788744353.653263:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788744353.653275:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154479488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744353.653314:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744353.653433:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154479488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (5059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.653459:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788744353.653480:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744353.653486:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154479616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744353.653500:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744353.653542:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154479616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744353.653548:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788744353.653725:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77aaa6d80 x1875634154479616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744353.653751:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154479616:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788744353.653767:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b46d80 x1875634154479488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744353.653780:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154479488:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788744354.159471:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744354.160217:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154479744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744354.160313:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744354.161894:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479744 00000100:00100000:0.0:1788744354.161912:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479744 00000100:00100000:0.0:1788744354.161977:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788744354.161988:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154479744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744354.162051:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744354.162140:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154479744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744354.162149:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1788744354.162504:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b46300 x1875634154479744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744354.162529:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154479744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744354.670709:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154479872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744354.670868:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744354.671868:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154479872 00000100:00100000:2.0:1788744354.671882:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154479872 00000100:00100000:2.0:1788744354.671948:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788744354.671962:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154479872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744354.671990:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744354.672073:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154479872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744354.672081:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788744354.672166:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc8a80 x1875634154479872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744354.672220:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154479872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744354.835855:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744354.837789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664576 00000100:00100000:0.0:1788744354.837791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744354.837807:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664576 00000100:00100000:0.0:1788744354.837837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744354.837880:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744354.837899:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 333 00000100:00100000:2.0:1788744354.837919:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138664576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744354.837929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744354.837979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664832 00000100:00100000:0.0:1788744354.837990:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664832 00000100:00100000:2.0:1788744354.838037:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138664576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 123us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744354.838055:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 333 00000100:00100000:0.0:1788744354.838060:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138665088 00000100:00100000:0.0:1788744354.838067:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138665088 00000100:00100000:0.0:1788744354.838094:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664704 00000100:00100000:0.0:1788744354.838097:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664704 00000100:00100000:0.0:1788744354.838116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138664960 00000100:00100000:0.0:1788744354.838118:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138664960 00000100:00080000:2.0:1788744354.838134:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744354.838142:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744354.838145:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:0.0:1788744354.838157:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138664832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744354.838202:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:2.0:1788744354.838228:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138665088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744354.838240:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138664832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744354.838260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:0.0:1788744354.838286:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:0.0:1788744354.838297:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138664704:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744354.838326:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138665088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 97us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744354.838336:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:0.0:1788744354.838344:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138664704:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744354.838355:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:2.0:1788744354.838602:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:2.0:1788744354.838616:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138664960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744354.838653:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138664960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744354.838660:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00010000:00010000:2.0:1788744355.182728:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744355.701769:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154480000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744355.701842:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744355.702001:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480000 00000100:00100000:1.0:1788744355.702010:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480000 00000100:00100000:1.0:1788744355.702053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788744355.702061:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154480000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744355.702093:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744355.702136:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154480000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744355.702156:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788744355.702209:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154480000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788744356.206598:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744356.719209:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744356.719233:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154480128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744356.719298:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744356.719479:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480128 00000100:00100000:3.0:1788744356.719488:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480128 00000100:00100000:3.0:1788744356.719551:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788744356.719560:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154480128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744356.719599:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788744356.719667:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154480128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744356.719674:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788744356.719884:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154480128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744357.237196:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744357.765329:0:13530:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:25:57 (1788744357) === 00000100:00100000:1.0:1788744358.031607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744358.031654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.031746:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138665216 00000100:00100000:2.0:1788744358.031755:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138665216 00000100:00100000:2.0:1788744358.031824:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788744358.031835:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138665216:12345-192.168.203.4@tcp:41:mkdir.0 00000004:00000024:2.0:1788744358.031872:0:7792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788744358.031957:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138665216:12345-192.168.203.4@tcp:41:mkdir.0 Request processed in 125us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.031964:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00080000:0.0:1788744358.032078:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744358.032727:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138665344 00000100:00100000:3.0:1788744358.032736:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138665344 00000100:00100000:3.0:1788744358.032828:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788744358.032838:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:10504:x1875634138665344:12345-192.168.203.4@tcp:700:mkdir.0 00000100:00100000:3.0:1788744358.032905:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:10504:x1875634138665344:12345-192.168.203.4@tcp:700:mkdir.0 Request processed in 68us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.032912:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788744358.036494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.036573:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138665600 00000100:00100000:3.0:1788744358.036906:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138665600 00000100:00100000:3.0:1788744358.037020:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1788744358.037031:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:10504:x1875634138665600:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:3.0:1788744358.037095:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744358.040483:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d331 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.040513:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac762c95400) 00010000:00010000:3.0:1788744358.040527:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744358.040624:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.040638:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.040667:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.040727:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.040735:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.040742:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041273:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041283:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041291:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744358.041306:0:6516:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000063f011d0 reply state 00000000282c418a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041317:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041323:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac750734100) 00010000:00010000:3.0:1788744358.041326:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744358.041329:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788744358.041334:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788744358.041341:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041354:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041361:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041367:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.041372:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041379:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041387:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac750734f00) 00010000:00010000:3.0:1788744358.041390:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744358.041393:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041454:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc2ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744358.041470:0:6516:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000063f011d0 reply state 00000000282c418a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041478:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.041484:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac750734a00) 00010000:00010000:3.0:1788744358.041487:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744358.041489:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788744358.041583:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:10504:x1875634138665600:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 4551us (5183us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788744358.041600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1788744358.064508:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744358.064613:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138665728 00000100:00100000:1.0:1788744358.064624:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138665728 00000100:00100000:1.0:1788744358.064683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788744358.064693:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:10505:x1875634138665728:12345-192.168.203.4@tcp:101:chmod.0 00010000:00010000:1.0:1788744358.064714:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744358.064737:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.064800:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc30b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.064815:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.064827:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744358.064875:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744358.064878:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744358.064914:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.065113:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3c4 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.065155:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc30b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3c4 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.065164:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6434edb00) 00010000:00010000:1.0:1788744358.065167:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744358.065170:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170e00, rc 0) 00000100:00100000:1.0:1788744358.065251:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:10505:x1875634138665728:12345-192.168.203.4@tcp:101:chmod.0 Request processed in 559us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744358.065259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788744358.067857:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.067934:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138665984 00000100:00100000:2.0:1788744358.067944:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138665984 00000100:00100000:2.0:1788744358.068026:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788744358.068036:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:10505:x1875634138665984:12345-192.168.203.4@tcp:36:chmod.0 00010000:00010000:2.0:1788744358.068086:0:10509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744358.068112:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc30b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3c4 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.068131:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6434edb00) 00010000:00010000:2.0:1788744358.068141:0:10509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744358.068164:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.068194:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.068204:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744358.068721:0:10509:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001b2dec91 reply state 0000000017640902 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.068738:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.068745:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:2.0:1788744358.068747:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788744358.068750:0:10509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788744358.068758:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788744358.068828:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:10505:x1875634138665984:12345-192.168.203.4@tcp:36:chmod.0 Request processed in 793us (978us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788744358.068836:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1788744358.104339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.104436:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138666112 00000100:00100000:3.0:1788744358.104447:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138666112 00000100:00100000:3.0:1788744358.104510:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788744358.104521:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:10506:x1875634138666112:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:3.0:1788744358.104545:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744358.104564:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3cb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.104629:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.104643:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.104654:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744358.104696:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788744358.104700:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744358.104740:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.104776:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3cb expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.104793:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3cb expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.104819:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:3.0:1788744358.104821:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744358.104826:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bee00, rc 0) 00000100:00100000:3.0:1788744358.104888:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:10506:x1875634138666112:12345-192.168.203.4@tcp:101:chown.0 Request processed in 370us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.104896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1788744358.108538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.108642:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138666240 00000100:00100000:2.0:1788744358.108652:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138666240 00000100:00100000:2.0:1788744358.108710:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:2.0:1788744358.108720:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:10506:x1875634138666240:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:2.0:1788744358.108742:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744358.108761:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82c00/0xb6207a6e76dcc327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3d2 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108823:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108836:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108847:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108859:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108866:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108872:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.108978:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc33c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109003:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc33c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109022:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc33c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744358.109136:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788744358.109140:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744358.109162:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc33c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109175:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109181:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109198:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109204:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b83600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.109207:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109215:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109226:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:2.0:1788744358.109229:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744358.109234:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109241:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b83600/0xb6207a6e76dcc32e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109265:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109271:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109277:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109282:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.109285:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109291:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109298:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac750734a00) 00010000:00010000:2.0:1788744358.109301:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744358.109304:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109309:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82600/0xb6207a6e76dcc335 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109336:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82c00/0xb6207a6e76dcc327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3d2 expref: 12 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109349:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc33c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3d2 expref: 11 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.109366:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac750734100) 00010000:00010000:2.0:1788744358.109369:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744358.109371:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58000, rc 0) 00000100:00100000:2.0:1788744358.109861:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:10506:x1875634138666240:12345-192.168.203.4@tcp:101:chown.0 Request processed in 1139us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.109870:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:2.0:1788744358.115832:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.115954:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138666368 00000100:00100000:3.0:1788744358.115964:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138666368 00000100:00100000:3.0:1788744358.116126:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788744358.116137:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:10506:x1875634138666368:12345-192.168.203.4@tcp:900:chown.0 00000100:00100000:3.0:1788744358.116230:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:10506:x1875634138666368:12345-192.168.203.4@tcp:900:chown.0 Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.116237:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788744358.122285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.122383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138666624 00000100:00100000:2.0:1788744358.122393:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138666624 00000100:00100000:2.0:1788744358.122566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788744358.122576:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:10506:x1875634138666624:12345-192.168.203.4@tcp:36:chown.0 00010000:00010000:2.0:1788744358.122625:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744358.122650:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc33c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3d2 expref: 11 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.122667:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac750734100) 00010000:00010000:2.0:1788744358.122672:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744358.122691:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.122704:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.122713:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744358.125204:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1788744358.125324:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125337:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125345:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125351:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.125356:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125364:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125390:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac750734a00) 00010000:00010000:3.0:1788744358.125393:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744358.125428:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125435:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc2f6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125455:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125460:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125465:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125470:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.125473:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125478:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125485:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac750734100) 00010000:00010000:3.0:1788744358.125487:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744358.125490:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125495:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc2fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125517:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125522:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125528:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125533:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.125536:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125541:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125548:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:3.0:1788744358.125550:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744358.125553:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125558:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac775b82e00/0xb6207a6e76dcc312 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744358.125638:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000acd17605 reply state 00000000d1c72c90 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.125658:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.125665:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac750734100) 00010000:00010000:2.0:1788744358.125668:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788744358.125670:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788744358.125682:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788744358.125795:0:6515:0:(ldlm_lib.c:3495:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788744358.125816:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:10506:x1875634138666624:12345-192.168.203.4@tcp:36:chown.0 Request processed in 3238us (3537us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788744358.125825:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:3.0:1788744358.125906:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125914:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125920:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125931:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.125935:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125942:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125950:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac750734100) 00010000:00010000:3.0:1788744358.125952:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744358.125955:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.125961:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59c00/0xb6207a6e76dcc343 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744358.137580:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.137683:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138666752 00000100:00100000:2.0:1788744358.137694:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138666752 00000100:00100000:2.0:1788744358.137760:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1788744358.137772:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:10507:x1875634138666752:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1788744358.137797:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744358.137817:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc34a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744358.139144:0:6517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1280us 00010000:00010000:2.0:1788744358.157709:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157733:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157756:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157774:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157792:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157800:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157920:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc35f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157928:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.157935:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744358.157963:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788744358.157967:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744358.158528:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158542:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158549:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158556:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158561:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.158565:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158578:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158589:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:2.0:1788744358.158592:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744358.158597:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158603:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158616:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158623:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158628:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158634:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.158637:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158642:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158649:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac74167c400) 00010000:00010000:2.0:1788744358.158651:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744358.158654:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158670:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158712:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc34a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3d9 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158726:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc35f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3d9 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.158733:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:2.0:1788744358.158735:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788744358.158738:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59400, rc 0) 00000100:00100000:2.0:1788744358.159123:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:10507:x1875634138666752:12345-192.168.203.4@tcp:101:touch.500 Request processed in 21351us (21549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.159132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788744358.164291:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.164363:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138667008 00000100:00100000:2.0:1788744358.164374:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138667008 00000100:00100000:2.0:1788744358.164479:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1788744358.164491:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:10507:x1875634138667008:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1788744358.164511:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744358.164530:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc366 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3e0 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.164633:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.164648:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.164672:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.164731:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.164739:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.164758:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744358.165572:0:7792:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788744358.165721:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc37b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165736:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165811:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165847:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165855:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165862:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165869:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.165880:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165888:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165900:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:2.0:1788744358.165903:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744358.165909:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165916:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc36d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744358.165930:0:7792:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008c543e44 reply state 00000000186a9ddf transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165940:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.165946:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff9ac76020d000) 00010000:00010000:2.0:1788744358.165948:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744358.165951:0:7792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744358.166091:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc366 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3e0 expref: 10 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.166110:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3e0 expref: 9 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.166119:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020dc00) 00010000:00010000:2.0:1788744358.166121:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744358.166130:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58e00, rc 0) 00000100:00100000:2.0:1788744358.166246:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:10507:x1875634138667008:12345-192.168.203.4@tcp:101:touch.500 Request processed in 1757us (1966us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788744358.166256:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1788744358.170805:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.170872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138667264 00000100:00100000:2.0:1788744358.170883:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138667264 00000100:00100000:2.0:1788744358.170931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1788744358.170941:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:10507:x1875634138667264:12345-192.168.203.4@tcp:36:touch.500 00010000:00010000:2.0:1788744358.171003:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744358.171030:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc37b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3e0 expref: 10 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.171046:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020dc00) 00010000:00010000:2.0:1788744358.171057:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744358.171104:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.171116:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.171125:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744358.171234:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004c8c8d7f reply state 000000002a3b7f08 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.171246:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.171253:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:2.0:1788744358.171267:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744358.171271:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744358.171375:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:10507:x1875634138667264:12345-192.168.203.4@tcp:36:touch.500 Request processed in 434us (578us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788744358.171382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788744358.174902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.174972:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138667392 00000100:00100000:2.0:1788744358.174983:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138667392 00000100:00100000:2.0:1788744358.175049:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788744358.175060:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:10507:x1875634138667392:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1788744358.175083:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744358.175103:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc390 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.175154:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3e7 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.175168:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3e7 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.175194:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:2.0:1788744358.175197:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744358.175202:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58800, rc 0) 00000100:00100000:2.0:1788744358.175250:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:10507:x1875634138667392:12345-192.168.203.4@tcp:101:touch.500 Request processed in 192us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.175258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:3.0:1788744358.178292:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.178375:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138667520 00000100:00100000:2.0:1788744358.178387:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138667520 00000100:00100000:2.0:1788744358.178477:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:2.0:1788744358.178499:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875634138667520:12345-192.168.203.4@tcp:8:touch.500 00010000:00080000:2.0:1788744358.178532:0:8432:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:2.0:1788744358.178563:0:8432:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc397 00002000:00100000:2.0:1788744358.178575:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e50f0a12-1dec-4e87-aa9a-b50e34f62300/ffff9ac774b01000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744358.178593:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744358.178661:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744358.178688:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ac775e87800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744358.178749:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138667520:12345-192.168.203.4@tcp:8:touch.500 Request processed in 251us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.178758:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1788744358.182571:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.182646:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138667648 00000100:00100000:2.0:1788744358.182655:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138667648 00000100:00100000:2.0:1788744358.182717:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788744358.182727:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138667648:12345-192.168.203.4@tcp:2:touch.500 00000100:00080000:0.0:1788744358.182907:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788744358.192636:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1788744358.192651:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000100:00100000:2.0:1788744358.192892:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:0:x1875634138667648:12345-192.168.203.4@tcp:2:touch.500 Request processed in 10161us (10324us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788744358.192903:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788744358.196809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744358.196954:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138667904 00000100:00100000:0.0:1788744358.196963:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138667904 00000100:00100000:0.0:1788744358.197020:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1788744358.197029:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:10507:x1875634138667904:12345-192.168.203.4@tcp:35:touch.500 00000100:00100000:0.0:1788744358.200826:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:10507:x1875634138667904:12345-192.168.203.4@tcp:35:touch.500 Request processed in 3785us (4014us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788744358.200841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788744358.217380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.217529:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138668032 00000100:00100000:2.0:1788744358.217539:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138668032 00000100:00100000:2.0:1788744358.217586:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788744358.217596:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:10508:x1875634138668032:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1788744358.217618:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744358.217637:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc39e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3ee expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.217726:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc3a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.217741:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.217752:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744358.217797:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788744358.217801:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744358.217854:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.217882:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc39e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3ee expref: 15 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.217901:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3ee expref: 14 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.217909:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:2.0:1788744358.217912:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744358.217915:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59000, rc 0) 00000100:00100000:2.0:1788744358.217991:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:10508:x1875634138668032:12345-192.168.203.4@tcp:101:rm.0 Request processed in 388us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.217999:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788744358.222394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.222699:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138668288 00000100:00100000:2.0:1788744358.222710:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138668288 00000100:00100000:2.0:1788744358.222773:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788744358.222784:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:10508:x1875634138668288:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1788744358.222806:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744358.222826:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc3ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3f5 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744358.222931:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788744358.223046:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc3ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3f5 expref: 16 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.223061:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:2.0:1788744358.223064:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744358.223069:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc3ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3f5 expref: 16 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.223082:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58e00, rc 0) 00000100:00100000:2.0:1788744358.223146:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:10508:x1875634138668288:12345-192.168.203.4@tcp:101:rm.0 Request processed in 363us (761us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788744358.223153:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788744358.226688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.226869:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138668416 00000100:00100000:3.0:1788744358.226880:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138668416 00000100:00100000:3.0:1788744358.226932:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788744358.226943:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:10508:x1875634138668416:12345-192.168.203.4@tcp:37:rm.0 00000100:00100000:1.0:1788744358.239020:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:10508:x1875634138668416:12345-192.168.203.4@tcp:37:rm.0 Request processed in 12069us (12330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744358.239032:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788744358.251632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744358.251723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138668672 00000100:00100000:0.0:1788744358.251733:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138668672 00000100:00100000:0.0:1788744358.251820:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:0.0:1788744358.251831:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750211c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:10508:x1875634138668672:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:0.0:1788744358.252055:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750211c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:10508:x1875634138668672:12345-192.168.203.4@tcp:35:rm.0 Request processed in 225us (431us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788744358.252063:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00010000:00010000:2.0:1788744358.257636:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744358.257778:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154480256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.257851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744358.258005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154480640:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.258038:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744358.258086:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154481152:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.258109:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744358.258123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154481664:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.258141:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261527:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154480768:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.261595:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261636:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154481280:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.261662:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261695:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154481792:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.261718:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261735:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788744358.261741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154480384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.261764:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261779:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154480896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.261798:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261814:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154481408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.261834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.261868:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480640 00000100:00100000:0.0:1788744358.261875:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480640 00000100:00100000:0.0:1788744358.261918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480384 00000100:00100000:0.0:1788744358.261921:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480384 00000100:00100000:0.0:1788744358.261932:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480896 00000100:00100000:0.0:1788744358.261935:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480896 00000100:00100000:0.0:1788744358.261956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481408 00000100:00100000:0.0:1788744358.261959:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481408 00000100:00100000:0.0:1788744358.261976:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788744358.261983:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154480640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.262033:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154480640:12345-0@lo:400:kworker.0 Request processed in 50us (3993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744358.262040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788744358.262058:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788744358.262063:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154480384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.262093:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154480384:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744358.262098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788744358.262118:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788744358.262124:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.262153:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154480896:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744358.262158:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788744358.262170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788744358.262266:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154481408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.262298:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154481408:12345-0@lo:400:kworker.0 Request processed in 122us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744358.262304:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788744358.262343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154480384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.262354:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154480896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.262363:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154481408:0@lo:400:kworker.0 00000100:00080000:0.0:1788744358.262395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744358.262631:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154480640:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.262643:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788744358.262652:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154480512:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.262681:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744358.262702:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154481024:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.262723:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744358.262742:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154481536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.262762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744358.262784:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481152 00000100:00100000:3.0:1788744358.262788:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481152 00000100:00100000:3.0:1788744358.262817:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481664 00000100:00100000:3.0:1788744358.262820:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481664 00000100:00100000:3.0:1788744358.262834:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481280 00000100:00100000:3.0:1788744358.262836:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481280 00000100:00100000:3.0:1788744358.262847:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481792 00000100:00100000:3.0:1788744358.262851:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481792 00000100:00100000:3.0:1788744358.262864:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744358.262870:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154481152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.262908:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154481152:12345-0@lo:400:kworker.0 Request processed in 38us (4798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.262915:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744358.262928:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744358.262934:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154481664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.262964:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154481664:12345-0@lo:400:kworker.0 Request processed in 31us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.262970:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744358.262981:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788744358.262997:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154481280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.263032:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154481280:12345-0@lo:400:kworker.0 Request processed in 36us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.263038:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788744358.263049:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788744358.263055:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154481792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.263082:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154481792:12345-0@lo:400:kworker.0 Request processed in 28us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.263088:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788744358.263106:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480768 00000100:00100000:3.0:1788744358.263111:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480768 00000100:00100000:3.0:1788744358.263134:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480512 00000100:00100000:3.0:1788744358.263137:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480512 00000100:00100000:3.0:1788744358.263149:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788744358.263153:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154480768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744358.263322:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.263604:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154480768:12345-0@lo:400:kworker.0 Request processed in 448us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.263612:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788744358.263627:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788744358.263634:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154480512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.263666:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154480512:12345-0@lo:400:kworker.0 Request processed in 32us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.263671:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788744358.263702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154480512:0@lo:400:kworker.0 00010000:00080000:3.0:1788744358.263716:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4e00 x1875634154481152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.263742:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154481152:0@lo:400:kworker.0 00010000:00080000:3.0:1788744358.263757:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7480 x1875634154481664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.263765:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154481664:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.263796:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154480768:0@lo:400:kworker.0 00010000:00080000:3.0:1788744358.263807:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb6300 x1875634154481280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.263816:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154481280:0@lo:400:kworker.0 00010000:00080000:3.0:1788744358.263825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb5500 x1875634154481792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.263833:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154481792:0@lo:400:kworker.0 00000100:00080000:3.0:1788744358.263855:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744358.263859:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744358.263870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481024 00000100:00100000:3.0:1788744358.263874:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481024 00000100:00100000:3.0:1788744358.263899:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481536 00000100:00100000:3.0:1788744358.263903:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481536 00000100:00100000:3.0:1788744358.263914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138668928 00000100:00100000:3.0:1788744358.263917:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138668928 00000100:00100000:3.0:1788744358.263932:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788744358.263938:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154481024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.263981:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154481024:12345-0@lo:400:kworker.0 Request processed in 42us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.263998:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788744358.264019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788744358.264024:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154481536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.264054:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154481536:12345-0@lo:400:kworker.0 Request processed in 30us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744358.264061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788744358.264073:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1788744358.264080:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:10508:x1875634138668928:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1788744358.264096:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744358.264117:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d3fc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788744358.264462:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744358.264542:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154480256 00000100:00100000:1.0:1788744358.264548:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154480256 00010000:00010000:3.0:1788744358.264753:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc3c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.264770:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc3c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.264780:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc3c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744358.264792:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788744358.264931:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3fc expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.264951:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3fc expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.264959:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:3.0:1788744358.264968:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744358.264972:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:1.0:1788744358.265127:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788744358.265137:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154480256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744358.265206:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154480256:12345-0@lo:400:kworker.0 Request processed in 71us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744358.265213:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788744358.265258:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138668928:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1178us (1937us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788744358.265264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00010000:00080000:3.0:1788744358.265299:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb6680 x1875634154481024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.265311:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154481024:0@lo:400:kworker.0 00010000:00080000:3.0:1788744358.265321:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7100 x1875634154481536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.265329:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154481536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.265354:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788744358.271622:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.272077:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138669056 00000100:00100000:2.0:1788744358.272088:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138669056 00000100:00100000:2.0:1788744358.272218:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1788744358.272230:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138669056:12345-192.168.203.4@tcp:41:rm.0 00000004:00000024:2.0:1788744358.272285:0:10509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788744358.272364:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138669056:12345-192.168.203.4@tcp:41:rm.0 Request processed in 136us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.272387:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:0.0:1788744358.275042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744358.275352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138669184 00000100:00100000:1.0:1788744358.275363:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138669184 00000100:00100000:1.0:1788744358.275449:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1788744358.275459:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138669184:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1788744358.275479:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744358.275499:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc3cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d403 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275560:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275574:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275586:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275597:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275604:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275629:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275711:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275720:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275727:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744358.275775:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788744358.275779:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744358.275795:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275807:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275815:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275821:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275827:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275834:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744358.275838:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275851:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275864:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:1.0:1788744358.275867:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744358.275872:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275878:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc3d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275891:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275897:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275903:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275908:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782171800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744358.275911:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275916:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275923:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff9ac76020d000) 00010000:00010000:1.0:1788744358.275926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744358.275928:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275945:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc3dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.275971:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc3cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d403 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.276146:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d403 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744358.276155:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:1.0:1788744358.276157:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744358.276160:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170c00, rc 0) 00000100:00100000:1.0:1788744358.276230:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:10508:x1875634138669184:12345-192.168.203.4@tcp:101:rm.0 Request processed in 772us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744358.276238:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1788744358.279588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.279824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138669440 00000100:00100000:3.0:1788744358.279835:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138669440 00000100:00100000:3.0:1788744358.279926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1788744358.279937:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:10508:x1875634138669440:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1788744358.279994:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744358.280019:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcc3e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d403 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280041:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3e7 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280052:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:3.0:1788744358.280078:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc3a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3ee expref: 17 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280087:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:3.0:1788744358.280090:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744358.280111:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280123:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280133:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280143:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280150:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280157:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280274:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280284:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280291:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744358.280630:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788744358.280651:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339962248533ns, next at 340962246436ns, rc = 0 00010000:00010000:3.0:1788744358.280697:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280706:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280714:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280721:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280728:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280733:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280757:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744358.280774:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280780:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280786:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280791:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.280795:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280813:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280822:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:3.0:1788744358.280824:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788744358.280828:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280834:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf800/0xb6207a6e76dcc3f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280850:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280855:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280861:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280866:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744358.280870:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280876:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280883:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:3.0:1788744358.280885:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744358.280888:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280904:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf600/0xb6207a6e76dcc3eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744358.280915:0:6516:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001463d050 reply state 00000000295f4d9a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280926:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744358.280932:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff9ac76020d000) 00010000:00010000:3.0:1788744358.280934:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744358.280937:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744358.281073:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744358.281080:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.281086:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfe00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744358.281089:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.281096:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.281105:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:2.0:1788744358.281107:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788744358.281110:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.281115:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc400 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.281125:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744358.281127:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744358.281129:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744358.281165:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138669440:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1228us (1584us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788744358.281174:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788744358.284753:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744358.284835:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138669696 00000100:00100000:3.0:1788744358.284845:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138669696 00000100:00100000:3.0:1788744358.284910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788744358.284922:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138669696:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1788744358.285154:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:10508:x1875634138669696:12345-192.168.203.4@tcp:35:rm.0 Request processed in 234us (419us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788744358.285162:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788744358.287931:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744358.288117:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138669952 00000100:00100000:2.0:1788744358.288126:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138669952 00000100:00100000:2.0:1788744358.288222:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788744358.288232:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:10508:x1875634138669952:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:2.0:1788744358.288292:0:10509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788744358.288317:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc3c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3fc expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288361:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc35f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3d9 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288372:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d100) 00010000:00010000:2.0:1788744358.288389:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3cb expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288397:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac74167cb00) 00010000:00010000:2.0:1788744358.288444:0:10509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744358.288468:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288481:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288490:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288503:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288509:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288516:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288603:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288621:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.288628:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744358.289240:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788744358.289257:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289265:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289271:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289278:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.289282:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289290:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289299:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ac76020d400) 00010000:00010000:2.0:1788744358.289302:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788744358.289305:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289311:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc415 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289331:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289345:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289352:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289357:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744358.289360:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289366:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289374:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac76020dc00) 00010000:00010000:2.0:1788744358.289376:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744358.289379:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289385:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc407 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744358.289397:0:10509:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001ff4990e reply state 0000000045445baa transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289538:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744358.289544:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac76020d500) 00010000:00010000:2.0:1788744358.289547:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744358.289550:0:10509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744358.289690:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:10508:x1875634138669952:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1457us (1765us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788744358.289705:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1788744358.768295:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744358.768317:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154482048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744358.768382:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744358.768479:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482048 00000100:00100000:0.0:1788744358.768487:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482048 00000100:00100000:0.0:1788744358.768532:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744358.768541:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154482048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744358.768579:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744358.768625:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154482048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744358.768632:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788744358.768681:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb7100 x1875634154482048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744358.768698:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154482048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744358.768920:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744358.768933:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154481920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744358.768965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744358.770058:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154481920 00000100:00100000:2.0:1788744358.770069:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154481920 00000100:00100000:2.0:1788744358.770108:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788744358.770116:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154481920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744358.770136:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744358.770216:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154481920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744358.770223:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788744358.770398:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437e2680 x1875634154481920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744358.770438:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154481920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788744359.278638:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744359.287125:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154482176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744359.287210:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744359.287335:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482176 00000100:00100000:1.0:1788744359.287343:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482176 00000100:00100000:1.0:1788744359.287391:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744359.287429:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154482176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744359.287461:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744359.287508:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154482176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744359.287529:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788744359.287570:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac64337fb80 x1875634154482176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744359.287592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154482176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744359.790817:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744359.790840:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154482304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744359.790917:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744359.791124:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482304 00000100:00100000:1.0:1788744359.791134:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482304 00000100:00100000:1.0:1788744359.791194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788744359.791204:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154482304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744359.791226:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744359.791280:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154482304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744359.791287:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788744359.791366:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc9880 x1875634154482304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744359.791384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154482304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744359.947723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744359.947771:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744359.947794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744359.947839:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744359.947870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670080 00000100:00100000:2.0:1788744359.947878:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670080 00000100:00100000:2.0:1788744359.947924:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 335 00000100:00100000:2.0:1788744359.947934:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138670080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744359.948016:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138670080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744359.948024:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 335 00000100:00100000:2.0:1788744359.948055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670208 00000100:00100000:2.0:1788744359.948059:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670208 00000100:00100000:2.0:1788744359.948096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670336 00000100:00100000:2.0:1788744359.948099:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670336 00000100:00100000:2.0:1788744359.948124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670592 00000100:00100000:2.0:1788744359.948127:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670592 00000100:00100000:2.0:1788744359.948144:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:2.0:1788744359.948151:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2397:x1875634138670208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744359.948202:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2397:x1875634138670208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744359.948209:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:2.0:1788744359.948222:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:2.0:1788744359.948228:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138670336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744359.948251:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138670336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744359.948257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:2.0:1788744359.948269:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:2.0:1788744359.948275:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138670592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744359.948297:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138670592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744359.948302:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00080000:3.0:1788744359.948530:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744359.948542:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744359.956547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744359.956586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744359.956614:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670464 00000100:00100000:0.0:1788744359.956623:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670464 00000100:00100000:0.0:1788744359.956672:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1788744359.956681:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138670464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744359.956756:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138670464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744359.956763:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1788744359.958086:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670720 00000100:00100000:0.0:1788744359.958096:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670720 00000100:00100000:0.0:1788744359.958165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:0.0:1788744359.958187:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138670720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744359.958258:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138670720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744359.958266:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00080000:2.0:1788744359.958356:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788744360.302691:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744360.815005:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154482432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744360.815080:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744360.815225:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482432 00000100:00100000:3.0:1788744360.815236:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482432 00000100:00100000:3.0:1788744360.815294:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788744360.815305:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154482432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744360.815341:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744360.815396:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154482432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744360.815433:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788744360.815742:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154482432:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788744361.329450:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744361.845180:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744361.845200:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154482560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744361.845260:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744361.845336:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482560 00000100:00100000:0.0:1788744361.845344:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482560 00000100:00100000:0.0:1788744361.845395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788744361.845434:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154482560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744361.845468:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744361.845511:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154482560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744361.845518:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788744361.845572:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154482560:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788744361.910313:0:13679:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788744362.350829:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744363.099376:0:13727:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefa2019e0 20000000:00000080:2.0:1788744363.099394:0:13727:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac77cd24800 uarg=0000000000000000 20000000:01000000:2.0:1788744363.099483:0:13727:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788744363.099489:0:13727:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788744363.099494:0:13727:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788744363.107138:0:13728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788744363.107305:0:13727:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788744363.120085:0:13727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788744363.120124:0:13727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788744363.120141:0:13727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788744363.120167:0:13727:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788744363.120186:0:13727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120204:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120352:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120377:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120384:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120392:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120398:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120436:0:13727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120477:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120490:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.120504:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154482688:0@lo:104: 00000100:00100000:0.0:1788744363.120574:0:13727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744363.120670:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788744363.120684:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482688 00000100:00100000:3.0:1788744363.120692:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482688 00010000:00010000:0.0:1788744363.120733:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.120742:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788744363.120742:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 23 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.120751:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64334d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:13727:x1875634154482688:12345-0@lo:104: 00000100:00100000:0.0:1788744363.120759:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154482816:0@lo:104: 00010000:00010000:3.0:1788744363.120763:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.120786:0:13727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744363.120805:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.120807:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744363.120813:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64334d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:13727:x1875634154482688:12345-0@lo:104: Request processed in 64us (239us total) trans 0 rc 0/0 00010000:00010000:0.0:1788744363.120814:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.120820:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744363.120822:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154482944:0@lo:104: 00000100:00100000:0.0:1788744363.120841:0:13727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744363.120855:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.120862:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 23 pid: 6509 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.120870:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482816 00000100:00100000:0.0:1788744363.120870:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154483072:0@lo:104: 00000100:00100000:3.0:1788744363.120874:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482816 00000100:00100000:3.0:1788744363.120884:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154482944 00000100:00100000:3.0:1788744363.120887:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154482944 00000100:00100000:0.0:1788744363.120887:0:13727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744363.120895:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154483072 00000100:00100000:3.0:1788744363.120897:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154483072 00010000:00010000:0.0:1788744363.120904:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.120906:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788744363.120914:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 12 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.120923:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154483200:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744363.120930:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+5:13727:x1875634154482816:12345-0@lo:104: 00010000:00010000:3.0:1788744363.120938:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.120969:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744363.120974:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+5:13727:x1875634154482816:12345-0@lo:104: Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.120980:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788744363.120991:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744363.120997:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+4:13727:x1875634154482944:12345-0@lo:104: 00010000:00010000:3.0:1788744363.121004:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121033:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788744363.121038:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+4:13727:x1875634154482944:12345-0@lo:104: Request processed in 41us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.121043:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744363.121055:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744363.121060:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:13727:x1875634154483072:12345-0@lo:104: 00010000:00010000:3.0:1788744363.121067:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.121081:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.121090:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 12 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121091:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788744363.121096:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+3:13727:x1875634154483072:12345-0@lo:104: Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.121102:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744363.121110:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154483328:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744363.121123:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788744363.121134:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121142:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744363.121146:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121166:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.121173:0:13727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380a80 going to sleep for 11 seconds 10000000:00010000:3.0:1788744363.121174:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744363.121179:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788744363.121192:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154482688:0@lo:104: 00000100:00100000:0.0:1788744363.121199:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154482816:0@lo:104: 00000100:00100000:0.0:1788744363.121205:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154482944:0@lo:104: 00010000:00010000:3.0:1788744363.121207:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121213:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744363.121234:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121240:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcc2e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121255:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788744363.121259:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121265:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744363.121268:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121285:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744363.121291:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744363.121296:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788744363.121313:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121318:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744363.121333:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121340:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740031c00/0xb6207a6e76dcc2d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121349:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744363.121352:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121358:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744363.121360:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.121368:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744363.121374:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744363.121385:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788744363.122482:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154483072:0@lo:104: 00010000:00010000:3.0:1788744363.123181:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123190:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744363.123204:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123211:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740030c00/0xb6207a6e76dcc2c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123228:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744363.123232:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123238:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfc00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744363.123241:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123249:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744363.123256:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744363.123262:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788744363.123279:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123285:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744363.123307:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123313:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc2b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcc2be expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.123328:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744363.123330:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744363.123332:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744363.123342:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744363.123362:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154483456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744363.123442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.124270:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154483456 00000100:00100000:2.0:1788744363.124280:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154483456 00010000:00010000:2.0:1788744363.124317:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 24 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744363.124347:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744363.124355:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154483456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744363.124368:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744363.124373:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 24 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744363.124386:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 24 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744363.124423:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b82400/0xb6207a6e76dcc2e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc2e1 expref: 24 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744363.124438:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744363.124483:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:3644:x1875634154483456:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.124490:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744363.125529:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154483584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744363.125581:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744363.128739:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744363.128874:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154483840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744363.128940:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154483584 00000100:00100000:0.0:1788744363.128950:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154483584 00000100:00100000:1.0:1788744363.128957:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744363.128997:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 23 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.129029:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154483840 00000100:00100000:0.0:1788744363.129032:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154483840 00010000:00010000:0.0:1788744363.129045:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 24 pid: 6509 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.129071:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744363.129080:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154483584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744363.129107:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744363.129111:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 24 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.129122:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 24 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.129139:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b82a00/0xb6207a6e76dcc2da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc2d3 expref: 24 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.129181:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744363.129227:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:3645:x1875634154483584:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.129234:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744363.129250:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744363.129256:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:3643:x1875634154483840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744363.129264:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744363.129268:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 22 pid: 6509 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.129276:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 22 pid: 6509 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.129305:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83000/0xb6207a6e76dcc2be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc2b7 expref: 22 pid: 6509 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.129315:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744363.129337:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3643:x1875634154483840:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.129344:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744363.132209:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154483712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744363.132278:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.132323:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154483712 00000100:00100000:0.0:1788744363.132331:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154483712 00010000:00010000:0.0:1788744363.132368:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.132422:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744363.132432:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3646:x1875634154483712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744363.132463:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744363.132469:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.132481:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.132484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154483456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744363.132497:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcc2cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcc2c5 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.132513:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744363.132622:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154483840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744363.138991:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3646:x1875634154483712:12345-0@lo:103:ldlm_bl.0 Request processed in 6551us (6703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.138998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154483712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744363.139006:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744363.140643:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744363.140675:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744363.140717:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670848 00000100:00100000:3.0:1788744363.140726:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670848 00010000:00010000:3.0:1788744363.140766:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 13 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.140797:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138670976 00000100:00100000:3.0:1788744363.140800:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138670976 00010000:00010000:3.0:1788744363.140811:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 14 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744363.140845:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788744363.140856:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+14:2394:x1875634138670848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744363.140871:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744363.140876:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 14 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.140904:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 14 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.140924:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744363.140983:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+14:2394:x1875634138670848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 129us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.140990:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788744363.141005:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:3.0:1788744363.141011:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138670976:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744363.141018:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744363.141022:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 13 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141030:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 13 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141041:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141050:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141064:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141071:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141078:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141090:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141096:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744363.141101:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141108:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141117:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.141128:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744363.141148:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138670976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.141165:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1788744363.141425:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154483584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744363.141790:0:13727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcc2b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3bd expref: 12 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.141805:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154483200:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744363.141815:0:13727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83800/0xb6207a6e76dcc2a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d3b6 expref: 11 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.141822:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875634154483328:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744363.141849:0:13727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.141859:0:13727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.141865:0:13727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.141883:0:13727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dac600/0xb6207a6e76dcc41c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.377273:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744363.378327:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154484352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.378424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.378477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154484864:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.378501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.378628:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154485376:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.378653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.378681:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788744363.378689:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154483968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744363.378777:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484352 00000100:00100000:3.0:1788744363.378788:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484352 00000100:00100000:3.0:1788744363.378845:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788744363.378856:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154484352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.381491:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154484224:0@lo:400:kworker.0 00000100:00100000:3.0:1788744363.382541:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154484352:12345-0@lo:400:kworker.0 Request processed in 3680us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.382554:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788744363.385628:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.385703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac64372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154484480:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.387168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154484992:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.387214:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154485504:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.387270:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154484352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387315:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484864 00000100:00100000:2.0:1788744363.387321:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484864 00000100:00100000:2.0:1788744363.387367:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485376 00000100:00100000:2.0:1788744363.387370:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485376 00000100:00100000:2.0:1788744363.387380:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484992 00000100:00100000:2.0:1788744363.387382:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484992 00000100:00100000:2.0:1788744363.387425:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485504 00000100:00100000:2.0:1788744363.387428:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485504 00000100:00100000:2.0:1788744363.387440:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788744363.387447:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154484864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387496:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154484864:12345-0@lo:400:kworker.0 Request processed in 49us (8994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.387502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788744363.387516:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744363.387521:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154485376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387548:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154485376:12345-0@lo:400:kworker.0 Request processed in 27us (8894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.387554:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744363.387564:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788744363.387569:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154484992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387591:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154484992:12345-0@lo:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.387596:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788744363.387604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788744363.387609:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154485504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.387629:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154485504:12345-0@lo:400:kworker.0 Request processed in 20us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.387634:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788744363.387652:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744363.387656:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744363.387674:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9df80 x1875634154484992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744363.387696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154484992:0@lo:400:kworker.0 00010000:00080000:2.0:1788744363.387707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e015500 x1875634154485504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744363.388568:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154483968 00000100:00100000:3.0:1788744363.388576:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154483968 00000100:00100000:3.0:1788744363.388620:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788744363.388635:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3643:x1875634154483968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744363.388679:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3643:x1875634154483968:12345-0@lo:400:kworker.0 Request processed in 46us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744363.388685:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788744363.389053:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154485504:0@lo:400:kworker.0 00010000:00080000:2.0:1788744363.389074:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb9f100 x1875634154484864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744363.389083:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154484864:0@lo:400:kworker.0 00010000:00080000:2.0:1788744363.389095:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e014000 x1875634154485376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744363.389103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154485376:0@lo:400:kworker.0 00000100:00100000:2.0:1788744363.389129:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154483968:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389276:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.389318:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154484736:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389345:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.389371:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154485248:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389391:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.389433:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788744363.389441:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154484096:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389460:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.389476:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154484608:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389494:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.389509:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154485120:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744363.389558:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484480 00000100:00100000:0.0:1788744363.389564:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484480 00000100:00100000:0.0:1788744363.389591:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484224 00000100:00100000:0.0:1788744363.389594:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484224 00000100:00100000:0.0:1788744363.389607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788744363.389614:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154484480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389657:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154484480:12345-0@lo:400:kworker.0 Request processed in 43us (2544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.389664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788744363.389689:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788744363.389694:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154484224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389727:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154484224:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.389733:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788744363.389757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484736 00000100:00100000:0.0:1788744363.389760:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484736 00000100:00100000:0.0:1788744363.389785:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485248 00000100:00100000:0.0:1788744363.389788:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485248 00000100:00100000:0.0:1788744363.389798:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484096 00000100:00100000:0.0:1788744363.389800:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484096 00000100:00100000:0.0:1788744363.389809:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154484608 00000100:00100000:0.0:1788744363.389811:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154484608 00000100:00100000:0.0:1788744363.389820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485120 00000100:00100000:0.0:1788744363.389822:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485120 00000100:00100000:0.0:1788744363.389833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788744363.389839:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154484736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389870:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154484736:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.389875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788744363.389887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788744363.389891:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154485248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389917:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154485248:12345-0@lo:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.389923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788744363.389933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788744363.389938:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154484096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.389964:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154484096:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.389977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788744363.389989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788744363.389995:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154484608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.390022:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154484608:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.390027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788744363.390038:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788744363.390044:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154485120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.390068:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154485120:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744363.390074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1788744363.390093:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744363.390097:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744363.390118:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154484096:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.390126:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154484608:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.390134:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154485120:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.390339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154484224:0@lo:400:kworker.0 00010000:00080000:0.0:1788744363.390350:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bdc00 x1875634154484736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744363.390360:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154484736:0@lo:400:kworker.0 00010000:00080000:0.0:1788744363.390368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e014700 x1875634154485248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744363.390376:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154485248:0@lo:400:kworker.0 00000100:00100000:0.0:1788744363.390626:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac64372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154484480:0@lo:400:kworker.0 00000004:00080000:3.0:1788744363.886710:0:10035:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345568305298ns, next at 346568302636ns, rc = 0 00000100:00100000:1.0:1788744363.887133:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744363.887163:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154485632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744363.887228:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.887362:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485632 00000100:00100000:2.0:1788744363.887370:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485632 00000100:00100000:2.0:1788744363.887450:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744363.887460:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154485632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744363.887484:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744363.887531:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154485632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.887538:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1788744363.887616:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b0e00 x1875634154485632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744363.887647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154485632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744363.888433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744363.888448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77ccbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154485760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744363.888493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744363.888658:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485760 00000100:00100000:2.0:1788744363.888665:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485760 00000100:00100000:2.0:1788744363.888698:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744363.888706:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154485760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744363.888731:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744363.888773:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154485760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744363.888780:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1788744363.888885:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77ccbd500 x1875634154485760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744363.888899:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77ccbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154485760:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788744363.889748:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788744363.889791:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788744363.889801:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788744363.890037:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154485888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788744363.890083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744363.890230:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890241:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890249:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890256:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744363.890260:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890267:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890282:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff9ac76020d000) 00010000:00010000:3.0:1788744363.890285:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744363.890290:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890305:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc374 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890333:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890339:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890345:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890350:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744363.890353:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890359:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890366:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ac76020d600) 00010000:00010000:3.0:1788744363.890368:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744363.890371:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890376:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58000/0xb6207a6e76dcc389 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890392:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890398:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890444:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890454:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744363.890458:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890464:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890472:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff9ac76020d000) 00010000:00010000:3.0:1788744363.890474:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744363.890477:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890483:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be800/0xb6207a6e76dcc3f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890497:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890503:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890508:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890513:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744363.890516:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890521:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890536:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac76020d500) 00010000:00010000:3.0:1788744363.890538:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744363.890541:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.890546:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58600/0xb6207a6e76dcc40e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744363.890767:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154485888 00000100:00100000:0.0:1788744363.890774:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154485888 00000100:00100000:0.0:1788744363.890815:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788744363.890824:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154485888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788744363.890845:0:8432:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788744363.890872:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e12a7, atime: 0x6a9e12a7, ctime: 0x6a9e12a7, blocks: 0x0 00010000:00010000:0.0:1788744363.890879:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.890892:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788744363.890896:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744363.890902:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.890916:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.890925:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.890933:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744363.891049:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744363.891201:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154485888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 377us (1115us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788744363.891214:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1788744363.891291:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac643c99880/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788744363.891297:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154485888:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788744363.891468:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744363.891475:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.891484:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744363.891487:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.891496:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.891512:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.891520:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc423 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744363.891537:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744363.891538:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744363.891544:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744364.079639:0:13776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0ce15b00 20000000:00000080:2.0:1788744364.079655:0:13776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac643cdd400 uarg=0000000000000000 20000000:01000000:2.0:1788744364.079697:0:13776:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788744364.079703:0:13776:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788744364.079709:0:13776:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788744364.080963:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788744364.081121:0:13776:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788744364.081371:0:13776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788744364.081506:0:13776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788744364.081530:0:13776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788744364.081544:0:13776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788744364.081564:0:13776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081580:0:13776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081591:0:13776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081598:0:13776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081605:0:13776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081613:0:13776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081620:0:13776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744364.081624:0:13776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081631:0:13776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081642:0:13776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081660:0:13776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.081666:0:13776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc42a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.398572:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744364.398884:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744364.398903:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154486016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744364.398963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744364.399065:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486016 00000100:00100000:3.0:1788744364.399074:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486016 00000100:00100000:3.0:1788744364.399107:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788744364.399115:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154486016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744364.399141:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744364.399188:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154486016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744364.399195:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1788744364.399595:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b0a80 x1875634154486016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744364.399613:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154486016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744364.426476:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744364.427250:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671104 00000100:00100000:2.0:1788744364.427260:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671104 00000100:00100000:2.0:1788744364.427319:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 337 00000100:00100000:2.0:1788744364.427331:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:6165:x1875634138671104:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744364.427349:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744364.427381:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcc431 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d40a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.427442:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcc431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d40a expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.427454:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcc431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d40a expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.427464:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59c00, rc 0) 00000100:00100000:2.0:1788744364.427527:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138671104:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744364.427534:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 337 00000100:00100000:3.0:1788744364.430988:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744364.431909:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671232 00000100:00100000:2.0:1788744364.431923:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671232 00000100:00100000:2.0:1788744364.432011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 338 00000100:00100000:2.0:1788744364.432022:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138671232:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744364.432388:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138671232:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 367us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744364.432396:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 338 00000100:00100000:0.0:1788744364.436725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744364.436813:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671360 00000100:00100000:3.0:1788744364.436824:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671360 00000100:00100000:3.0:1788744364.436877:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 339 00000100:00100000:3.0:1788744364.436888:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138671360:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744364.437042:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138671360:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 156us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744364.437050:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 339 00000100:00100000:3.0:1788744364.444806:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744364.445094:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671488 00000100:00100000:0.0:1788744364.445105:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671488 00000100:00100000:0.0:1788744364.445168:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 340 00000100:00100000:0.0:1788744364.445178:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:10792:x1875634138671488:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744364.445338:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:10792:x1875634138671488:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 161us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744364.445347:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 340 00000100:00100000:0.0:1788744364.452729:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744364.452875:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671616 00000100:00100000:2.0:1788744364.452886:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671616 00000100:00100000:2.0:1788744364.452939:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 341 00000100:00100000:2.0:1788744364.452948:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:10792:x1875634138671616:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744364.453102:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:10792:x1875634138671616:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 154us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744364.453112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 341 00000100:00100000:1.0:1788744364.463806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744364.464047:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671744 00000100:00100000:3.0:1788744364.464057:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671744 00000100:00100000:3.0:1788744364.464112:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 342 00000100:00100000:3.0:1788744364.464122:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:6165:x1875634138671744:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744364.464162:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744364.464179:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc438 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d411 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.464207:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d411 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.464217:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d411 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.464225:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be800, rc 0) 00000100:00100000:3.0:1788744364.464289:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138671744:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 168us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744364.464297:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 342 00000100:00100000:3.0:1788744364.473449:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744364.473555:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138671872 00000100:00100000:0.0:1788744364.473565:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138671872 00000100:00100000:0.0:1788744364.473622:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 343 00000100:00100000:0.0:1788744364.473634:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138671872:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744364.473799:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138671872:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 167us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744364.473808:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 343 00000100:00100000:1.0:1788744364.477901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744364.478053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672000 00000100:00100000:0.0:1788744364.478063:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672000 00000100:00100000:0.0:1788744364.478127:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 344 00000100:00100000:0.0:1788744364.478136:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138672000:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744364.478285:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:6165:x1875634138672000:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 149us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744364.478302:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 344 00000100:00100000:1.0:1788744364.481243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744364.481741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672128 00000100:00100000:3.0:1788744364.481752:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672128 00000100:00100000:3.0:1788744364.481808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:3.0:1788744364.481818:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:10796:x1875634138672128:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744364.481971:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:10796:x1875634138672128:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 154us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744364.481979:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:3.0:1788744364.488476:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744364.488598:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672256 00000100:00100000:2.0:1788744364.488607:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672256 00000100:00100000:2.0:1788744364.488659:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 346 00000100:00100000:2.0:1788744364.488668:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:10796:x1875634138672256:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744364.488822:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:10796:x1875634138672256:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 154us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744364.488831:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 346 00000100:00100000:1.0:1788744364.912439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154486144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744364.912522:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744364.912710:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486144 00000100:00100000:3.0:1788744364.912718:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486144 00000100:00100000:3.0:1788744364.912774:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788744364.912784:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154486144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744364.912819:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744364.912870:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154486144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744364.912877:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788744364.913015:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac76e014700 x1875634154486144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744364.913033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154486144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744365.067864:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744365.067906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744365.067993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744365.068030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744365.068049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744365.068069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744365.068157:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672512 00000100:00100000:0.0:1788744365.068169:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672512 00000100:00100000:0.0:1788744365.068231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673024 00000100:00100000:0.0:1788744365.068235:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673024 00000100:00100000:0.0:1788744365.068249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672640 00000100:00100000:0.0:1788744365.068251:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672640 00000100:00100000:0.0:1788744365.068265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672896 00000100:00100000:0.0:1788744365.068267:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672896 00000100:00100000:0.0:1788744365.068283:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:0.0:1788744365.068292:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138672512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744365.068341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:3.0:1788744365.068354:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138673024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744365.068368:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138672512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.068378:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:0.0:1788744365.068447:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:3.0:1788744365.068449:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138673024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.068459:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138672640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744365.068460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:3.0:1788744365.068481:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:3.0:1788744365.068490:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138672896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744365.068504:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138672640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.068512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:3.0:1788744365.068525:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138672896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744365.068533:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:0.0:1788744365.068565:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672384 00000100:00100000:0.0:1788744365.068569:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672384 00000100:00100000:0.0:1788744365.068593:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 347 00000100:00100000:0.0:1788744365.068601:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138672384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744365.068627:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac744718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138672384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.068635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 347 00000100:00080000:1.0:1788744365.070177:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788744365.070185:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744365.070445:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138672768 00000100:00100000:2.0:1788744365.070455:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138672768 00000100:00100000:2.0:1788744365.070538:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:2.0:1788744365.070548:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138672768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744365.070628:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138672768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744365.070636:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00080000:1.0:1788744365.070755:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1788744365.103119:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744365.103126:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac642271000 from 7 10000000:01000000:3.0:1788744365.103131:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744365.103186:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.103198:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.103208:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744365.103233:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.103312:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.103490:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643c1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.103570:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486272 00000100:00100000:1.0:1788744365.103590:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486272 00000100:00100000:1.0:1788744365.106952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788744365.106979:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+20:6513:x1875634154486272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744365.107000:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744365.107034:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac782170c00/0xb6207a6e76dcc446 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc43f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744365.107062:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac782170c00/0xb6207a6e76dcc446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc43f expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744365.107075:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac782170c00/0xb6207a6e76dcc446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc43f expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744365.107083:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170c00, rc 0) 00000100:00100000:1.0:1788744365.107188:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154486272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.107195:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788744365.107293:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744365.107313:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.107322:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744365.107439:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.107474:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.108547:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643c1d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744365.108695:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486400 00000100:00100000:0.0:1788744365.108703:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486400 00000100:00100000:0.0:1788744365.108815:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788744365.108825:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154486400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.109339:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154486400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.109348:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788744365.109457:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.109498:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.109545:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.109584:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643c1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.109700:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486528 00000100:00100000:1.0:1788744365.109705:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486528 00000100:00100000:1.0:1788744365.109730:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788744365.109737:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154486528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.109828:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154486528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.109834:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788744365.110118:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.110621:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13789:1875634154486656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744365.110664:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.110697:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ad0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.110866:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486656 00000100:00100000:1.0:1788744365.110872:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486656 00000100:00100000:1.0:1788744365.110908:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788744365.110915:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:13789:x1875634154486656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744365.111024:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+21:13789:x1875634154486656:12345-0@lo:502:llog_process_th.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.111031:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788744365.111347:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13789:1875634154486656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744365.111372:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744365.111382:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.111385:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744365.111391:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac642271000 00000020:00000080:3.0:1788744365.111423:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744365.111483:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744365.111487:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.111488:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744365.111491:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744365.111494:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.111495:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788744365.111499:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac642271000 00000020:00000080:3.0:1788744365.111501:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744365.111534:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13789:1875634154486784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744365.111570:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.111607:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643c1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744365.111662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486784 00000100:00100000:2.0:1788744365.111667:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486784 00000100:00100000:2.0:1788744365.111700:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788744365.111707:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:13789:x1875634154486784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744365.111806:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+21:13789:x1875634154486784:12345-0@lo:502:llog_process_th.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744365.111812:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788744365.112447:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13789:1875634154486784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744365.112472:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744365.112478:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744365.112479:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788744365.112484:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788744365.112852:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788744365.112878:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744365.112886:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.112897:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744365.112906:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744365.112909:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac77c9d5000 from 7 10000000:01000000:2.0:1788744365.112911:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744365.112954:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.112961:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.112971:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744365.112989:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744365.113027:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744365.113062:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744365.113232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154486912 00000100:00100000:0.0:1788744365.113239:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154486912 00000100:00100000:0.0:1788744365.113279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788744365.113287:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+21:6513:x1875634154486912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744365.113299:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744365.113312:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcc454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc44d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.113335:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcc454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc44d expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.113345:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcc454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc44d expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.113353:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643daca00, rc 0) 00000100:00100000:0.0:1788744365.113389:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154486912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.113436:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788744365.115561:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154486912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744365.115601:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.115612:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744365.115691:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744365.115768:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744365.115810:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642653180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744365.115828:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487040 00000100:00100000:2.0:1788744365.115833:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487040 00000100:00100000:2.0:1788744365.115868:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788744365.115877:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154487040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744365.116441:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154487040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744365.116449:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788744365.116550:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.116599:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.116648:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744365.116671:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744365.116789:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487168 00000100:00100000:3.0:1788744365.116797:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487168 00000100:00100000:3.0:1788744365.116836:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788744365.116844:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154487168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.116935:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154487168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744365.116954:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788744365.117355:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.119343:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13790:1875634154487296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744365.119457:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744365.119499:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744365.120033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487296 00000100:00100000:3.0:1788744365.120041:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487296 00000100:00100000:3.0:1788744365.120088:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788744365.120098:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:13790:x1875634154487296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744365.120358:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:13790:x1875634154487296:12345-0@lo:502:llog_process_th.0 Request processed in 260us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744365.120366:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788744365.120499:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13790:1875634154487296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744365.120528:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744365.120537:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744365.120539:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744365.120545:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac77c9d5000 00000020:00000080:0.0:1788744365.120548:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744365.120605:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744365.120609:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744365.120610:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744365.120613:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744365.120615:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744365.120616:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788744365.120620:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac77c9d5000 00000020:00000080:0.0:1788744365.120622:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744365.120657:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13790:1875634154487424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744365.120692:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744365.120717:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744365.120905:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487424 00000100:00100000:2.0:1788744365.120911:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487424 00000100:00100000:2.0:1788744365.120962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788744365.120972:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:13790:x1875634154487424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744365.121077:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+22:13790:x1875634154487424:12345-0@lo:502:llog_process_th.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744365.121085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788744365.121551:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13790:1875634154487424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744365.122674:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744365.122690:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.122692:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788744365.122697:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788744365.124054:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788744365.124089:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744365.124099:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.124331:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744365.124343:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744365.124346:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac774b65800 from 7 10000000:01000000:2.0:1788744365.124349:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744365.124386:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.124430:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.124441:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744365.124466:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744365.124525:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744365.124565:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744365.125700:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487552 00000100:00100000:0.0:1788744365.125712:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487552 00000100:00100000:0.0:1788744365.125775:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788744365.125786:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+22:6513:x1875634154487552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744365.125801:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744365.125817:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcc462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc45b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.125843:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcc462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc45b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.125853:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcc462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc45b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.125862:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac400, rc 0) 00000100:00100000:0.0:1788744365.125920:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154487552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.125928:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788744365.127728:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e014000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744365.127765:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744365.127777:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744365.127861:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.127910:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744365.129223:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744365.129246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487680 00000100:00100000:0.0:1788744365.129253:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487680 00000100:00100000:0.0:1788744365.129308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788744365.129317:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154487680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.129468:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154487680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744365.129475:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788744365.129513:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.129551:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744365.132083:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744365.134392:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744365.143769:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487808 00000100:00100000:3.0:1788744365.143784:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487808 00000100:00100000:3.0:1788744365.143897:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788744365.143909:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154487808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.144086:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154487808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744365.144096:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788744365.144294:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154487808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.144701:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13793:1875634154487936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744365.144754:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744365.144895:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744365.144993:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154487936 00000100:00100000:3.0:1788744365.144999:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154487936 00000100:00100000:3.0:1788744365.145063:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788744365.145071:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:13793:x1875634154487936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744365.145190:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:13793:x1875634154487936:12345-0@lo:502:llog_process_th.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744365.145198:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788744365.145267:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13793:1875634154487936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744365.145289:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744365.145299:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744365.145301:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744365.145314:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac774b65800 00000020:00000080:2.0:1788744365.145316:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744365.145367:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744365.145370:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744365.145372:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744365.145374:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744365.145377:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744365.145378:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788744365.145381:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac774b65800 00000020:00000080:2.0:1788744365.145383:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744365.145438:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13793:1875634154488064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744365.145476:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744365.146176:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.146882:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488064 00000100:00100000:1.0:1788744365.146891:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488064 00000100:00100000:1.0:1788744365.146933:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788744365.146941:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:13793:x1875634154488064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744365.147275:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+23:13793:x1875634154488064:12345-0@lo:502:llog_process_th.0 Request processed in 334us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.147284:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788744365.147738:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13793:1875634154488064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744365.147781:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744365.147788:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744365.147791:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788744365.147800:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788744365.149265:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788744365.149299:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744365.149787:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.149802:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744365.149814:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744365.149816:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75196e800 from 7 10000000:01000000:3.0:1788744365.149829:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744365.149865:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.149874:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.149885:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744365.149908:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154488192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744365.149968:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.150014:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6431e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744365.150178:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488192 00000100:00100000:3.0:1788744365.150256:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488192 00000100:00100000:3.0:1788744365.150353:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788744365.150363:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+23:6513:x1875634154488192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744365.150376:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744365.150396:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437bf800/0xb6207a6e76dcc470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcc469 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.150436:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437bf800/0xb6207a6e76dcc470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcc469 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.150447:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437bf800/0xb6207a6e76dcc470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcc469 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744365.150455:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf800, rc 0) 00000100:00100000:3.0:1788744365.150508:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154488192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744365.150525:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788744365.150612:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154488192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744365.150628:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744365.150646:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744365.150715:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154488320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744365.150748:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744365.151826:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77caf4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.151862:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488320 00000100:00100000:1.0:1788744365.151870:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488320 00000100:00100000:1.0:1788744365.151905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788744365.151912:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154488320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.152061:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154488320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.152069:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788744365.152120:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154488320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.152171:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154488448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.152682:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744365.152833:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.152853:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488448 00000100:00100000:1.0:1788744365.152858:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488448 00000100:00100000:1.0:1788744365.152885:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788744365.152893:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154488448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.152981:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:6513:x1875634154488448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.152995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788744365.153048:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46c76a72-ee71-482d-9002-d7642a89bcb9:6513:1875634154488448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744365.153572:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13794:1875634154488576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744365.153611:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744365.153765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488576 00000100:00100000:1.0:1788744365.153771:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488576 00000100:00100000:1.0:1788744365.153792:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788744365.153798:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:13794:x1875634154488576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744365.153874:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:13794:x1875634154488576:12345-0@lo:502:llog_process_th.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.153881:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788744365.153913:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.153925:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13794:1875634154488576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744365.153949:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744365.153957:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744365.153959:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788744365.153966:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac75196e800 00000020:00000080:1.0:1788744365.153969:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744365.154020:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744365.156148:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.156156:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744365.156170:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744365.156178:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.156179:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788744365.156196:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac75196e800 00000020:00000080:3.0:1788744365.156199:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744365.156289:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13794:1875634154488704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744365.156393:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744365.156454:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6431e5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744365.158922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488704 00000100:00100000:1.0:1788744365.158938:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488704 00000100:00100000:1.0:1788744365.162912:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788744365.162937:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:13794:x1875634154488704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744365.163566:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:13794:x1875634154488704:12345-0@lo:502:llog_process_th.0 Request processed in 639us (7175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.163585:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788744365.170275:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46c76a72-ee71-482d-9002-d7642a89bcb9:13794:1875634154488704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744365.170531:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744365.170672:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744365.170675:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788744365.170681:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:3.0:1788744365.173353:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1788744365.175693:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788744365.175732:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744365.175744:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744365.175756:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744365.201758:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744365.422765:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744365.936761:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744365.936785:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154488832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744365.936857:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744365.936924:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488832 00000100:00100000:1.0:1788744365.936934:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488832 00000100:00100000:1.0:1788744365.936996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788744365.937005:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154488832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744365.937041:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744365.937115:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154488832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744365.937123:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788744365.937259:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154488832:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788744366.191175:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788744366.255515:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744366.447723:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744366.959756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154488960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744366.959826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744366.960084:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154488960 00000100:00100000:0.0:1788744366.960094:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154488960 00000100:00100000:0.0:1788744366.960167:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788744366.960177:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154488960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744366.960211:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744366.961385:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154488960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1203us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744366.961397:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744366.965081:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154488960:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744367.472775:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744368.495293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154489088:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495358:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495427:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154489600:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495450:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495466:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154490112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495498:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495512:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154490624:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495545:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788744368.495550:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154489472:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495578:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154489984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495606:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154490496:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495621:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.495643:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490112 00000100:00100000:2.0:1788744368.495650:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490112 00000100:00100000:2.0:1788744368.495692:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490624 00000100:00100000:2.0:1788744368.495694:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490624 00000100:00100000:2.0:1788744368.495704:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489984 00000100:00100000:2.0:1788744368.495706:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489984 00000100:00100000:2.0:1788744368.495715:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490496 00000100:00100000:2.0:1788744368.495717:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490496 00000100:00100000:2.0:1788744368.495729:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744368.495736:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154490112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495779:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154490112:12345-0@lo:400:kworker.0 Request processed in 43us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744368.495786:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744368.495801:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744368.495806:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154490624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495826:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154490624:12345-0@lo:400:kworker.0 Request processed in 20us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744368.495840:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744368.495849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744368.495854:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154489984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495876:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154489984:12345-0@lo:400:kworker.0 Request processed in 22us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744368.495881:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744368.495890:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788744368.495894:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154490496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.495914:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154490496:12345-0@lo:400:kworker.0 Request processed in 20us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744368.495919:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788744368.495935:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744368.495939:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744368.495964:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489600 00000100:00100000:2.0:1788744368.495967:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489600 00000100:00100000:2.0:1788744368.495989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788744368.495994:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154489600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.496023:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154489600:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744368.496028:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:2.0:1788744368.496067:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437c8e00 x1875634154489984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744368.496082:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154489984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.496092:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154490496:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489472 00000100:00100000:0.0:1788744368.496236:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489472 00000100:00100000:0.0:1788744368.496273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788744368.496281:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154489472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496327:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154489472:12345-0@lo:400:kworker.0 Request processed in 47us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744368.496335:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788744368.496365:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154489344:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744368.496428:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154489856:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496450:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744368.496469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154490368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496492:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.496493:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154489600:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496511:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788744368.496520:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154489216:0@lo:400:kworker.0 00010000:00080000:2.0:1788744368.496526:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437cad80 x1875634154490112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744368.496537:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154490112:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496545:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.496551:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154490624:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496567:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154489728:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.496585:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154489472:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.496609:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.496628:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489856 00000100:00100000:0.0:1788744368.496633:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154490240:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.496634:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489856 00000100:00100000:0.0:1788744368.496662:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744368.496678:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490368 00000100:00100000:2.0:1788744368.496683:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490368 00000100:00100000:2.0:1788744368.496704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489216 00000100:00100000:2.0:1788744368.496707:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489216 00000100:00100000:0.0:1788744368.496713:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489728 00000100:00100000:2.0:1788744368.496717:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490240 00000100:00100000:0.0:1788744368.496720:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489728 00000100:00100000:2.0:1788744368.496722:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490240 00000100:00100000:2.0:1788744368.496750:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788744368.496758:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154489856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.497393:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154489856:12345-0@lo:400:kworker.0 Request processed in 634us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744368.497469:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489088 00000100:00100000:1.0:1788744368.497474:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489088 00000100:00100000:1.0:1788744368.497507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788744368.497515:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154489088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744368.497554:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154489088:12345-0@lo:400:kworker.0 Request processed in 40us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744368.497560:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788744368.497599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.501556:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788744368.501585:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154490368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.501961:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154490368:12345-0@lo:400:kworker.0 Request processed in 391us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744368.501971:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788744368.502002:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788744368.502009:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154489216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.502050:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154489216:12345-0@lo:400:kworker.0 Request processed in 43us (5507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744368.502055:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788744368.502067:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788744368.502072:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154489728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.502094:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154489728:12345-0@lo:400:kworker.0 Request processed in 22us (5501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744368.502099:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788744368.502109:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788744368.502128:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154490240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.502169:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154490240:12345-0@lo:400:kworker.0 Request processed in 54us (5507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744368.502174:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00010000:0.0:1788744368.502235:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744368.502441:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744368.502446:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744368.502459:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154489344 00000100:00100000:0.0:1788744368.502467:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154489344 00000100:00100000:0.0:1788744368.502500:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788744368.502506:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154489344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.502537:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154489344:12345-0@lo:400:kworker.0 Request processed in 32us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744368.502543:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788744368.502587:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154489216:0@lo:400:kworker.0 00000100:00100000:2.0:1788744368.503415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788744368.503506:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154489728:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.503540:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154490240:0@lo:400:kworker.0 00000100:00100000:0.0:1788744368.503550:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154489344:0@lo:400:kworker.0 00010000:00080000:0.0:1788744368.503562:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f1c00 x1875634154489856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744368.503572:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154489856:0@lo:400:kworker.0 00010000:00080000:0.0:1788744368.503583:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6437c9880 x1875634154490368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744368.503590:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788744369.006839:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744369.006860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154490752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744369.006924:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744369.006997:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490752 00000100:00100000:3.0:1788744369.007004:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490752 00000100:00100000:3.0:1788744369.007045:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744369.007070:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875634154490752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744369.007126:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744369.007172:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875634154490752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744369.007179:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744369.007224:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154490752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744369.009254:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744369.009286:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154490880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744369.009344:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744369.009464:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154490880 00000100:00100000:0.0:1788744369.009473:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154490880 00000100:00100000:0.0:1788744369.009529:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788744369.009538:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154490880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744369.009559:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744369.009611:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154490880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744369.009618:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788744369.009754:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154490880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744369.518829:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744369.518853:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154491008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744369.518924:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744369.519203:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491008 00000100:00100000:0.0:1788744369.519211:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491008 00000100:00100000:0.0:1788744369.519265:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788744369.519274:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154491008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744369.519731:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744369.519783:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154491008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 510us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744369.519791:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1788744369.519925:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435b0700 x1875634154491008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744369.519947:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154491008:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788744369.523032:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788744369.523377:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744370.030968:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744370.030994:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154491136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744370.031062:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744370.032815:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491136 00000100:00100000:2.0:1788744370.032830:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491136 00000100:00100000:2.0:1788744370.032910:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788744370.032921:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154491136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744370.032969:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744370.033057:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154491136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744370.033073:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788744370.033184:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643728a80 x1875634154491136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744370.033205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154491136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744370.033289:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744370.187311:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744370.187530:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673152 00000100:00100000:2.0:1788744370.187542:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673152 00000100:00100000:2.0:1788744370.187671:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 369 00000100:00100000:2.0:1788744370.187689:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138673152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744370.187762:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138673152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744370.187770:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 369 00000100:00100000:3.0:1788744370.210864:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744370.210937:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744370.210979:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744370.211021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744370.211049:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744370.211502:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673280 00000100:00100000:1.0:1788744370.211517:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673280 00000100:00100000:1.0:1788744370.211601:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673408 00000100:00100000:1.0:1788744370.211605:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673408 00000100:00100000:1.0:1788744370.211620:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673664 00000100:00100000:1.0:1788744370.211622:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673664 00000100:00100000:1.0:1788744370.211638:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673792 00000100:00100000:1.0:1788744370.211641:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673792 00000100:00100000:1.0:1788744370.211673:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:1.0:1788744370.211691:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138673280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744370.211786:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138673280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 96us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744370.211794:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:1.0:1788744370.211814:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:1.0:1788744370.211821:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138673408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744370.211849:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138673408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744370.211855:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:1.0:1788744370.211882:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:1.0:1788744370.211889:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138673664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744370.211917:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138673664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744370.211922:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:1.0:1788744370.211935:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:1.0:1788744370.211942:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138673792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744370.211976:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138673792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744370.211982:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00080000:3.0:1788744370.212062:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744370.212070:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744370.213236:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673536 00000100:00100000:2.0:1788744370.213256:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673536 00000100:00100000:2.0:1788744370.213353:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:2.0:1788744370.213365:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138673536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744370.213497:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138673536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 135us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744370.213507:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00080000:3.0:1788744370.214285:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788744370.543488:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744371.054885:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744371.054915:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154491264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744371.055007:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744371.055142:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491264 00000100:00100000:2.0:1788744371.055154:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491264 00000100:00100000:2.0:1788744371.055220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788744371.055232:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154491264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744371.055289:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744371.055359:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154491264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744371.055366:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788744371.056124:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154491264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744371.566682:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744372.080274:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744372.080307:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154491392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744372.080436:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744372.081845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491392 00000100:00100000:0.0:1788744372.081860:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491392 00000100:00100000:0.0:1788744372.081946:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744372.081958:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154491392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744372.082005:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744372.082110:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154491392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744372.082118:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788744372.085777:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154491392:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744372.590931:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744373.614823:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac775a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154491520:0@lo:400:kworker.0 00000100:00100000:3.0:1788744373.614900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744373.615030:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491520 00000100:00100000:2.0:1788744373.615039:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491520 00000100:00100000:2.0:1788744373.615099:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788744373.615109:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.619910:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154491520:12345-0@lo:400:kworker.0 Request processed in 4790us (4997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744373.619927:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788744373.620021:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154491648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.620074:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744373.620184:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491648 00000100:00100000:1.0:1788744373.620192:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491648 00000100:00100000:1.0:1788744373.620252:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788744373.620262:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154491648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.620318:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154491648:12345-0@lo:400:kworker.0 Request processed in 58us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744373.620324:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:0.0:1788744373.620586:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744373.620605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154491904:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.620637:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744373.620655:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154492416:0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.620757:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154491776:0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.620787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744373.620805:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154492288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.620825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744373.620839:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154492800:0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.620860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744373.620890:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491904 00000100:00100000:1.0:1788744373.620907:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491904 00000100:00100000:1.0:1788744373.620933:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492288 00000100:00100000:1.0:1788744373.620935:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492288 00000100:00100000:1.0:1788744373.620956:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492800 00000100:00100000:1.0:1788744373.620958:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492800 00000100:00100000:1.0:1788744373.620974:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788744373.620981:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154491904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.621021:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154491904:12345-0@lo:400:kworker.0 Request processed in 41us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744373.621028:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788744373.621041:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788744373.621047:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154492288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.621081:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154492288:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744373.621098:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788744373.621110:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788744373.621117:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154492800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744373.621144:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154492800:12345-0@lo:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744373.621150:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1788744373.621166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788744373.621192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a7b80 x1875634154492288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744373.621207:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154492288:0@lo:400:kworker.0 00010000:00080000:1.0:1788744373.621218:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a6300 x1875634154492800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744373.621252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154492800:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.621665:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744373.621805:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154492928:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.621831:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744373.621864:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154491904:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.621897:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492416 00000100:00100000:0.0:1788744373.621902:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492416 00000100:00100000:0.0:1788744373.621934:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492928 00000100:00100000:0.0:1788744373.621937:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492928 00000100:00100000:0.0:1788744373.621955:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788744373.621966:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154492416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.622006:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154492416:12345-0@lo:400:kworker.0 Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744373.622012:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788744373.622025:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788744373.622031:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154492928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.622058:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154492928:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744373.622064:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788744373.622098:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a5f80 x1875634154492416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744373.622107:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154492416:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.622117:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154492928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154491776 00000100:00100000:2.0:1788744373.622219:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154491776 00000100:00100000:2.0:1788744373.622264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744373.622271:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154491776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622316:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154491776:12345-0@lo:400:kworker.0 Request processed in 45us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744373.622323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744373.622357:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154491776:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622376:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154492160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622423:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744373.622443:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154492672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622463:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744373.622489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154491648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622511:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788744373.622517:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154492032:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744373.622557:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154492544:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622575:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744373.622589:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154493056:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.622605:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744373.622626:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492032 00000100:00100000:2.0:1788744373.622629:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492032 00000100:00100000:2.0:1788744373.622649:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788744373.622655:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154492032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.622855:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492544 00000100:00100000:0.0:1788744373.622859:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492544 00000100:00100000:0.0:1788744373.622879:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493056 00000100:00100000:0.0:1788744373.622881:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493056 00000100:00100000:0.0:1788744373.622894:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744373.622900:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154492544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.622936:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154492544:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744373.622952:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744373.622963:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788744373.622969:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154493056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.622998:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154493056:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744373.623002:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788744373.623018:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492160 00000100:00100000:0.0:1788744373.623021:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492160 00000100:00100000:0.0:1788744373.623043:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154492672 00000100:00100000:0.0:1788744373.623045:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154492672 00000100:00100000:0.0:1788744373.623062:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788744373.623068:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154492160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.623108:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154492160:12345-0@lo:400:kworker.0 Request processed in 40us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744373.623114:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788744373.623126:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788744373.623133:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154492672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.623158:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154492672:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744373.623163:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00080000:0.0:1788744373.623206:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a4380 x1875634154492544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744373.623216:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154492544:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.623224:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788744373.623241:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac643c99880, transno 4294967301 00000100:00100000:0.0:1788744373.623258:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154493056:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.623271:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154492160:0@lo:400:kworker.0 00000100:00100000:0.0:1788744373.623279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154492672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744373.623576:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154492032:12345-0@lo:400:kworker.0 Request processed in 919us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744373.623584:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788744373.623685:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744373.623689:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744373.623692:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744373.623958:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788744373.624034:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac775a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154491520:0@lo:400:kworker.0 00000100:00100000:3.0:1788744374.127090:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744374.127113:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154493184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744374.127177:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744374.127376:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493184 00000100:00100000:2.0:1788744374.127385:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493184 00000100:00100000:2.0:1788744374.127462:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788744374.127472:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154493184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744374.127502:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744374.127549:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154493184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744374.127555:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744374.127782:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154493312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744374.127812:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744374.127873:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154493184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744374.127937:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493312 00000100:00100000:2.0:1788744374.127942:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493312 00000100:00100000:2.0:1788744374.127971:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788744374.127978:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154493312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744374.128003:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744374.128041:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154493312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744374.128048:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744374.128155:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154493312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788744374.640054:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744374.641260:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154493440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744374.641330:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744374.641537:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493440 00000100:00100000:0.0:1788744374.641546:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493440 00000100:00100000:0.0:1788744374.641602:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788744374.641612:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154493440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744374.641640:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744374.641685:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154493440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744374.641692:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1788744374.641765:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a6a00 x1875634154493440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744374.641785:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154493440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744375.150883:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154493568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744375.150951:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744375.151083:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493568 00000100:00100000:2.0:1788744375.151091:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493568 00000100:00100000:2.0:1788744375.151153:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788744375.151163:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154493568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744375.151185:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744375.151229:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154493568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744375.151236:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788744375.151296:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788744375.151573:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77aaa6d80 x1875634154493568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744375.151592:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77aaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154493568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744375.311550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744375.311598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744375.311655:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744375.311666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138673920 00000100:00100000:2.0:1788744375.311678:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138673920 00000100:00100000:3.0:1788744375.311694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744375.311720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744375.311735:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 371 00000100:00100000:2.0:1788744375.311747:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138673920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744375.311817:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138673920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744375.311824:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 371 00000100:00100000:2.0:1788744375.311873:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674304 00000100:00100000:2.0:1788744375.311878:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674304 00000100:00100000:2.0:1788744375.311913:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1788744375.311922:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138674304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744375.311938:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744375.311956:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138674304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744375.311963:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:1.0:1788744375.311991:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674176 00000100:00100000:1.0:1788744375.311996:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674176 00000100:00080000:2.0:1788744375.312008:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744375.312012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744375.312027:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674432 00000100:00100000:1.0:1788744375.312031:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674432 00000100:00100000:1.0:1788744375.312051:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674048 00000100:00100000:1.0:1788744375.312053:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674048 00000100:00100000:1.0:1788744375.312065:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674560 00000100:00100000:1.0:1788744375.312067:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674560 00000100:00100000:1.0:1788744375.312091:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:1.0:1788744375.312098:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138674176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744375.312133:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138674176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744375.312139:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:1.0:1788744375.312152:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:1.0:1788744375.312159:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138674432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744375.312181:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138674432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744375.312194:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:1.0:1788744375.312207:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:1.0:1788744375.312212:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138674048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744375.312238:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138674048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744375.312708:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:0.0:1788744375.312721:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138674560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744375.312749:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138674560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744375.312754:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00080000:0.0:1788744375.312805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744375.312808:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744375.317942:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 236 00010000:00010000:2.0:1788744375.663825:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744376.176702:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154493696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744376.176783:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744376.179979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493696 00000100:00100000:2.0:1788744376.179992:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493696 00000100:00100000:2.0:1788744376.180046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788744376.180055:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154493696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744376.180103:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744376.180173:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154493696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744376.180179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788744376.180576:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154493696:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788744376.432947:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788744376.495344:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744376.686590:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744377.202389:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744377.202437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154493824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744377.202520:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744377.202679:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493824 00000100:00100000:2.0:1788744377.202688:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493824 00000100:00100000:2.0:1788744377.202744:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788744377.202754:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154493824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744377.202787:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788744377.202850:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154493824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744377.202857:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788744377.203750:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154493824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744377.710524:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744378.734693:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744378.734799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154494080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.734868:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744378.734930:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744378.734937:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154494208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.734963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744378.734988:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744378.734995:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154494336:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.735030:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744378.735095:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494080 00000100:00100000:1.0:1788744378.735102:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494080 00000100:00100000:1.0:1788744378.735142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494336 00000100:00100000:1.0:1788744378.735145:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494336 00000100:00100000:1.0:1788744378.735163:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788744378.735171:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154494080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.735249:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154494080:12345-0@lo:400:kworker.0 Request processed in 78us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744378.735256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788744378.735273:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788744378.735280:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154494336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.735312:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154494336:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744378.735319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788744378.735337:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494208 00000100:00100000:1.0:1788744378.735340:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494208 00000100:00100000:1.0:1788744378.735363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788744378.735370:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154494208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.735398:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154494208:12345-0@lo:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744378.735432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788744378.735465:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154494336:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.735489:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154494208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.735498:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154494080:0@lo:400:kworker.0 00010000:00010000:2.0:1788744378.736041:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744378.736996:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.737087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744378.737319:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154493952 00000100:00100000:2.0:1788744378.737328:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154493952 00000100:00100000:2.0:1788744378.737382:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788744378.737392:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154493952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.737473:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154493952:12345-0@lo:400:kworker.0 Request processed in 83us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744378.737481:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788744378.738164:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154493952:0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.738471:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154494592:0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.738535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744378.738593:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744378.738611:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154494464:0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.738640:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744378.738690:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494464 00000100:00100000:3.0:1788744378.738702:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494464 00000100:00100000:3.0:1788744378.738744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788744378.738753:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154494464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.738805:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154494464:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744378.738812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788744378.738850:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154494464:0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.738887:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494592 00000100:00100000:3.0:1788744378.738891:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494592 00000100:00100000:3.0:1788744378.738933:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788744378.738940:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154494592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788744378.739437:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744378.739454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.739507:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744378.739553:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494720 00000100:00100000:1.0:1788744378.739558:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494720 00000100:00100000:1.0:1788744378.739614:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788744378.739622:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154494720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.739666:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154494720:12345-0@lo:400:kworker.0 Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744378.739673:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:1.0:1788744378.739693:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788744378.739714:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a6d80 x1875634154494720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744378.739726:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154494720:0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.742641:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154494592:12345-0@lo:400:kworker.0 Request processed in 3690us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744378.742656:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788744378.742911:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154494592:0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.743499:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154494848:0@lo:400:kworker.0 00000100:00100000:3.0:1788744378.743822:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744378.743951:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494848 00000100:00100000:1.0:1788744378.743959:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494848 00000100:00100000:1.0:1788744378.744028:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788744378.744037:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154494848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.744126:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154494976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.744159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744378.744191:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154494976 00000100:00100000:2.0:1788744378.744195:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154494976 00000100:00100000:2.0:1788744378.744220:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788744378.744237:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154494976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.744273:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154494976:12345-0@lo:400:kworker.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744378.744279:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1788744378.744312:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a4700 x1875634154494976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744378.744324:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154494976:0@lo:400:kworker.0 00000100:00080000:2.0:1788744378.744370:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744378.744923:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154495232:0@lo:400:kworker.0 00000100:00100000:0.0:1788744378.744962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744378.744985:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744378.744990:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154495104:0@lo:400:kworker.0 00000100:00100000:0.0:1788744378.745011:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744378.745056:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495232 00000100:00100000:0.0:1788744378.745062:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495232 00000100:00100000:0.0:1788744378.745098:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495104 00000100:00100000:0.0:1788744378.745101:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495104 00000100:00100000:0.0:1788744378.745121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788744378.745127:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154495232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744378.745164:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154495232:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744378.745172:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788744378.745184:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788744378.745189:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154495104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744378.745213:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154495104:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744378.745218:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788744378.745231:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744378.745375:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154495488:0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.745427:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744378.745446:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744378.745452:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154495360:0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.745472:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744378.745492:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495488 00000100:00100000:2.0:1788744378.745496:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495488 00000100:00100000:2.0:1788744378.745518:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495360 00000100:00100000:2.0:1788744378.745533:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495360 00000100:00100000:2.0:1788744378.745549:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788744378.745555:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154495488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.745613:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154495488:12345-0@lo:400:kworker.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744378.745620:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788744378.745634:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788744378.745639:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154495360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.745664:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154495360:12345-0@lo:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744378.745669:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788744378.745701:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154495360:0@lo:400:kworker.0 00000100:00100000:2.0:1788744378.745710:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154495488:0@lo:400:kworker.0 00000100:00080000:0.0:1788744378.745877:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744378.745880:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744378.745899:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154495104:0@lo:400:kworker.0 00010000:00080000:0.0:1788744378.745912:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a4380 x1875634154495232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744378.745922:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154495232:0@lo:400:kworker.0 00000100:00100000:1.0:1788744378.752288:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154494848:12345-0@lo:400:kworker.0 Request processed in 8239us (8453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744378.752303:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1788744378.752536:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a5f80 x1875634154494848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744378.752552:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154494848:0@lo:400:kworker.0 00000100:00100000:3.0:1788744379.246790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154495616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744379.246859:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744379.246978:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495616 00000100:00100000:2.0:1788744379.246986:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495616 00000100:00100000:2.0:1788744379.247042:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788744379.247061:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154495616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744379.247090:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744379.247139:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154495616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744379.247145:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788744379.247190:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154495616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744379.248919:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744379.248937:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75304ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154495744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744379.248993:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744379.250525:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495744 00000100:00100000:1.0:1788744379.250539:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495744 00000100:00100000:1.0:1788744379.250603:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788744379.250615:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154495744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744379.250643:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744379.250719:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154495744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744379.250726:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744379.251008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75304ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154495744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788744379.758565:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744379.758924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154495872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744379.759009:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744379.759332:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154495872 00000100:00100000:1.0:1788744379.759340:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154495872 00000100:00100000:1.0:1788744379.759392:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788744379.759419:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154495872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744379.759453:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744379.759524:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154495872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744379.759532:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1788744379.759625:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdb4700 x1875634154495872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744379.759643:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154495872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744380.272674:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154496000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744380.272748:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744380.272986:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496000 00000100:00100000:2.0:1788744380.272996:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496000 00000100:00100000:2.0:1788744380.273076:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744380.273087:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154496000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744380.273117:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744380.273163:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154496000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744380.273170:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788744380.273209:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435a5f80 x1875634154496000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744380.273226:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154496000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744380.273360:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744380.451370:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744380.451511:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674688 00000100:00100000:0.0:1788744380.451523:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674688 00000100:00100000:0.0:1788744380.451604:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 373 00000100:00100000:0.0:1788744380.451615:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138674688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744380.451685:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138674688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744380.451693:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 373 00000100:00100000:2.0:1788744380.452780:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744380.452815:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744380.452835:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744380.452867:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674944 00000100:00100000:3.0:1788744380.452874:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674944 00000100:00100000:0.0:1788744380.452926:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138674816 00000100:00100000:0.0:1788744380.452930:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138674816 00000100:00100000:2.0:1788744380.452958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744380.452993:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675200 00000100:00100000:2.0:1788744380.452994:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744380.452997:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675200 00000100:00100000:2.0:1788744380.453027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675328 00000100:00100000:2.0:1788744380.453031:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675328 00000100:00100000:1.0:1788744380.453067:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675072 00000100:00100000:1.0:1788744380.453072:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675072 00000100:00100000:0.0:1788744380.453462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:0.0:1788744380.453473:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138674944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744380.453543:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138674944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744380.453550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:0.0:1788744380.453572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:0.0:1788744380.453579:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138674816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744380.453609:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138674816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744380.453614:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00080000:0.0:1788744380.453844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744380.453851:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744380.453853:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744380.454176:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:2.0:1788744380.454186:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138675328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744380.454220:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:2.0:1788744380.454223:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138675328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744380.454227:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138675200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744380.454230:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:3.0:1788744380.454254:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138675200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744380.454261:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:1.0:1788744380.454446:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788744380.454456:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2393:x1875634138675072:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1788744380.454487:0:8966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc397 00000100:00080000:1.0:1788744380.454496:0:8966:0:(import.c:65:import_set_state_nolock()) ffff9ac775e87800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744380.454546:0:8966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:3.0:1788744380.454619:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744380.454667:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+2:2393:x1875634138675072:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 213us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744380.454674:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00010000:00010000:2.0:1788744380.782664:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744381.294607:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154496128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744381.294661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744381.294783:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496128 00000100:00100000:1.0:1788744381.294792:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496128 00000100:00100000:1.0:1788744381.295744:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788744381.295759:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154496128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744381.295793:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744381.295868:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154496128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744381.295875:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788744381.295966:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154496128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744381.806675:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744382.320184:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744382.320212:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154496256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744382.320294:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744382.320442:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496256 00000100:00100000:2.0:1788744382.320468:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496256 00000100:00100000:2.0:1788744382.320525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788744382.320534:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154496256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744382.320574:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788744382.320623:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154496256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744382.320630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788744382.321636:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154496256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744382.835328:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744383.855046:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154496384:0@lo:400:kworker.0 00010000:00010000:3.0:1788744383.855064:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744383.855080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154496768:0@lo:400:kworker.0 00000100:00100000:1.0:1788744383.855162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154496512:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858033:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744383.858117:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154497280:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744383.858168:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154497792:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858188:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744383.858222:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788744383.858246:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154496640:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858272:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744383.858293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154497152:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858314:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744383.858330:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154497664:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858348:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744383.858384:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496640 00000100:00100000:3.0:1788744383.858392:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496640 00000100:00100000:3.0:1788744383.858458:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788744383.858466:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154496640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858521:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154496640:12345-0@lo:400:kworker.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.858528:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788744383.858549:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496768 00000100:00100000:3.0:1788744383.858553:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496768 00000100:00100000:3.0:1788744383.858576:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497152 00000100:00100000:3.0:1788744383.858579:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497152 00000100:00100000:3.0:1788744383.858611:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497664 00000100:00100000:3.0:1788744383.858614:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497664 00000100:00100000:3.0:1788744383.858627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788744383.858646:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154496768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858678:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154496768:12345-0@lo:400:kworker.0 Request processed in 45us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.858684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788744383.858696:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788744383.858702:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154497152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858728:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154497152:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.858740:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788744383.858751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788744383.858757:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154497664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858786:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154497664:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.858791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788744383.858833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154496640:0@lo:400:kworker.0 00010000:00080000:3.0:1788744383.858845:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad7800 x1875634154497152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744383.858855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154497152:0@lo:400:kworker.0 00010000:00080000:3.0:1788744383.858863:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc4e00 x1875634154497664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744383.858870:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154497664:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858880:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154496768:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.858921:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497280 00000100:00100000:3.0:1788744383.858925:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497280 00000100:00100000:3.0:1788744383.858948:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497792 00000100:00100000:3.0:1788744383.858951:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497792 00000100:00100000:3.0:1788744383.858970:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788744383.858976:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154497280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.859012:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154497280:12345-0@lo:400:kworker.0 Request processed in 35us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.859030:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788744383.859048:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788744383.859055:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154497792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.859084:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154497792:12345-0@lo:400:kworker.0 Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.859089:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1788744383.859116:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac774ad5180 x1875634154497280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744383.859125:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154497280:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.859134:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154497792:0@lo:400:kworker.0 00000100:00080000:3.0:1788744383.859157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744383.859161:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744383.859163:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744383.859250:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744383.859287:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154496896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859313:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744383.859348:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496896 00000100:00100000:0.0:1788744383.859353:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496896 00000100:00100000:0.0:1788744383.859383:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788744383.859390:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154496896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859440:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154496896:12345-0@lo:400:kworker.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744383.859446:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788744383.859537:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154496896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859544:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154497408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859578:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744383.859597:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497408 00000100:00100000:0.0:1788744383.859601:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497408 00000100:00100000:0.0:1788744383.859624:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788744383.859629:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154497408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859656:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154497408:12345-0@lo:400:kworker.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744383.859662:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788744383.859674:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744383.859692:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc4a80 x1875634154497408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744383.859702:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154497408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859709:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154497920:0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.859737:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744383.859757:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497920 00000100:00100000:0.0:1788744383.859760:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497920 00000100:00100000:0.0:1788744383.859795:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788744383.859800:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154497920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788744383.859811:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744383.859828:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154497920:12345-0@lo:400:kworker.0 Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744383.859834:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788744383.859858:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154497920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.859859:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496384 00000100:00100000:3.0:1788744383.859866:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496384 00000100:00100000:3.0:1788744383.859899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788744383.859908:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154496384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.859944:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154496384:12345-0@lo:400:kworker.0 Request processed in 39us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.859950:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788744383.863423:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154496384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744383.866783:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744383.867014:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac774ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154497024:0@lo:400:kworker.0 00000100:00100000:1.0:1788744383.867055:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744383.867471:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154497536:0@lo:400:kworker.0 00000100:00100000:1.0:1788744383.867496:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744383.870708:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154496512 00000100:00100000:2.0:1788744383.870722:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154496512 00000100:00100000:0.0:1788744383.870722:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497024 00000100:00100000:0.0:1788744383.870727:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497024 00000100:00100000:2.0:1788744383.870775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154497536 00000100:00100000:2.0:1788744383.870778:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154497536 00000100:00100000:0.0:1788744383.870810:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788744383.872488:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154496512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.872582:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154496512:12345-0@lo:400:kworker.0 Request processed in 1765us (5804us total) trans 0 rc 0/0 00000100:00080000:1.0:1788744383.872726:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744383.872771:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154496512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744383.874199:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788744383.874211:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154497024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744383.874316:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788744383.874325:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154497536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744383.875984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788744383.878156:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154497024:12345-0@lo:400:kworker.0 Request processed in 3939us (11091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744383.878171:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788744383.878340:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154497536:12345-0@lo:400:kworker.0 Request processed in 4014us (10841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744383.878348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788744383.878462:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac774ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154497024:0@lo:400:kworker.0 00000100:00100000:1.0:1788744383.878476:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154497536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744384.367385:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744384.367422:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154498048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744384.367497:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744384.367664:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498048 00000100:00100000:0.0:1788744384.367673:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498048 00000100:00100000:0.0:1788744384.367719:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744384.367728:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154498048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744384.367756:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744384.367798:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154498048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744384.367806:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788744384.367942:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154498048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744384.371712:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154498176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744384.371780:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744384.371872:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498176 00000100:00100000:0.0:1788744384.371891:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498176 00000100:00100000:0.0:1788744384.371942:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744384.371951:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154498176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744384.371970:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744384.375558:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154498176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3599us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744384.375671:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788744384.376974:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154498176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788744384.878523:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744384.878958:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744384.878979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154498304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744384.879051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744384.879215:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498304 00000100:00100000:2.0:1788744384.879224:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498304 00000100:00100000:2.0:1788744384.879271:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788744384.879280:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154498304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744384.879309:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744384.879350:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154498304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744384.879356:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1788744384.880279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb51880 x1875634154498304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744384.880299:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154498304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744385.392148:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744385.392169:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154498432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744385.392450:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744385.392560:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498432 00000100:00100000:1.0:1788744385.392568:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498432 00000100:00100000:1.0:1788744385.392635:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788744385.392645:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154498432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744385.392667:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744385.392714:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154498432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744385.392721:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788744385.392762:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc6300 x1875634154498432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744385.392788:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154498432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744385.396164:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744385.549364:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744385.549431:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744385.549465:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675584 00000100:00100000:3.0:1788744385.549473:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744385.549477:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675584 00000100:00100000:3.0:1788744385.549502:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744385.549535:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744385.549545:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675840 00000100:00100000:2.0:1788744385.549550:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675840 00000100:00100000:3.0:1788744385.549562:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675456 00000100:00100000:3.0:1788744385.549567:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675456 00000100:00100000:2.0:1788744385.549571:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675712 00000100:00100000:2.0:1788744385.549577:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675712 00000100:00100000:2.0:1788744385.549600:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138675968 00000100:00100000:2.0:1788744385.549603:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138675968 00000100:00100000:3.0:1788744385.549608:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 375 00000100:00100000:3.0:1788744385.549620:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138675456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744385.549627:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:2.0:1788744385.549638:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138675584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744385.549695:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138675456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744385.549702:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 375 00000100:00100000:3.0:1788744385.549734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:3.0:1788744385.549742:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138675840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744385.551117:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138675584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 1471us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744385.551129:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:2.0:1788744385.551160:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 256 00000100:00100000:2.0:1788744385.551170:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138675712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744385.551212:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138675712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744385.551219:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 256 00000100:00100000:2.0:1788744385.551232:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:2.0:1788744385.551239:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138675968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744385.551261:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138675968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744385.551267:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00080000:2.0:1788744385.551287:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744385.551292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744385.552815:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac774ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138675840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 3058us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744385.552829:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 255 00010000:00010000:3.0:1788744385.902581:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744386.415394:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154498560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744386.415486:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744386.415553:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498560 00000100:00100000:1.0:1788744386.415561:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498560 00000100:00100000:1.0:1788744386.415601:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788744386.415610:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154498560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744386.415640:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788744386.415683:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154498560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744386.415691:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788744386.415757:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154498560:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788744386.419180:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:2.0:1788744386.419195:0:9507:0:(genops.c:885:class_export_put()) final put ffff9ac774b01000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:0.0:1788744386.420551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac774b01000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-OST0001 00000020:00000080:0.0:1788744386.420619:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac775e87800 for lustre-OST0001 00000040:00080000:3.0:1788744386.672141:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788744386.735051:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788744386.926829:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744387.438872:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154498688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744387.438945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744387.439131:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498688 00000100:00100000:0.0:1788744387.439140:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498688 00000100:00100000:0.0:1788744387.439194:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744387.439205:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154498688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744387.439240:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788744387.439302:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154498688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744387.439308:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788744387.439392:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154498688:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788744387.957045:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744388.979818:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744388.979847:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154499200:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.979922:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.979973:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154499712:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980010:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154500224:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980052:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980076:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788744388.980083:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154498816:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980138:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154499328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980196:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154499840:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980232:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980251:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154500352:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980308:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154498944:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980331:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980352:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154499456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980374:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980392:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154499968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980592:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980619:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788744388.980626:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154499072:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980652:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980682:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154499584:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980708:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980724:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154500096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980749:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744388.980778:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499200 00000100:00100000:3.0:1788744388.980785:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499200 00000100:00100000:3.0:1788744388.980821:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498944 00000100:00100000:3.0:1788744388.980824:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498944 00000100:00100000:3.0:1788744388.980836:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499456 00000100:00100000:3.0:1788744388.980838:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499456 00000100:00100000:3.0:1788744388.980862:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499968 00000100:00100000:3.0:1788744388.980865:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499968 00000100:00100000:3.0:1788744388.980879:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499584 00000100:00100000:3.0:1788744388.980881:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499584 00000100:00100000:3.0:1788744388.980894:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500096 00000100:00100000:3.0:1788744388.980896:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500096 00000100:00100000:3.0:1788744388.980914:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788744388.980924:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154499200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.980976:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154499200:12345-0@lo:400:kworker.0 Request processed in 54us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.980993:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788744388.981009:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788744388.981015:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154498944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981046:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154498944:12345-0@lo:400:kworker.0 Request processed in 31us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981051:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788744388.981062:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788744388.981067:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154499456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981101:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154499456:12345-0@lo:400:kworker.0 Request processed in 35us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981107:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788744388.981119:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788744388.981124:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154499968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981147:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154499968:12345-0@lo:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981153:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788744388.981164:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788744388.981170:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154499584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981193:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154499584:12345-0@lo:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981199:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788744388.981318:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499328 00000100:00100000:0.0:1788744388.981322:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499328 00000100:00100000:0.0:1788744388.981354:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499072 00000100:00100000:0.0:1788744388.981358:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499072 00000100:00100000:0.0:1788744388.981373:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744388.981380:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154499328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744388.981443:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154499328:12345-0@lo:400:kworker.0 Request processed in 64us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744388.981455:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744388.981468:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788744388.981475:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154499072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744388.981503:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154499072:12345-0@lo:400:kworker.0 Request processed in 29us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744388.981509:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788744388.981617:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788744388.981629:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154500096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981666:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154500096:12345-0@lo:400:kworker.0 Request processed in 42us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981673:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788744388.981695:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499712 00000100:00100000:3.0:1788744388.981698:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499712 00000100:00100000:3.0:1788744388.981717:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500224 00000100:00100000:3.0:1788744388.981719:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500224 00000100:00100000:3.0:1788744388.981730:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154499840 00000100:00100000:3.0:1788744388.981733:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154499840 00000100:00100000:3.0:1788744388.981744:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500352 00000100:00100000:3.0:1788744388.981747:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500352 00000100:00100000:3.0:1788744388.981758:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788744388.981774:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154499712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981809:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154499712:12345-0@lo:400:kworker.0 Request processed in 38us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981816:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788744388.981831:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788744388.981838:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154500224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981869:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154500224:12345-0@lo:400:kworker.0 Request processed in 32us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981875:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788744388.981888:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788744388.981895:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154499840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981921:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154499840:12345-0@lo:400:kworker.0 Request processed in 28us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981927:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788744388.981938:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788744388.981945:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154500352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.981973:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154500352:12345-0@lo:400:kworker.0 Request processed in 30us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.981979:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788744388.982013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154498816 00000100:00100000:3.0:1788744388.982017:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154498816 00000100:00100000:3.0:1788744388.982086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788744388.982093:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154498816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744388.982125:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77a9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154498816:12345-0@lo:400:kworker.0 Request processed in 32us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744388.982140:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:2.0:1788744388.982173:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744388.982178:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744388.982181:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744388.982183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744388.982222:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154498816:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982236:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154499328:0@lo:400:kworker.0 00010000:00080000:2.0:1788744388.982247:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75325fb80 x1875634154499840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744388.982258:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154499840:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154500352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982278:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154499200:0@lo:400:kworker.0 00010000:00080000:2.0:1788744388.982289:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75325ce00 x1875634154499712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744388.982296:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154499712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982304:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154500224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982352:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154499072:0@lo:400:kworker.0 00010000:00080000:2.0:1788744388.982363:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75325d880 x1875634154499584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744388.982371:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154499584:0@lo:400:kworker.0 00010000:00080000:2.0:1788744388.982392:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75325f100 x1875634154500096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744388.982832:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154500096:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982855:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154498944:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154499456:0@lo:400:kworker.0 00000100:00100000:2.0:1788744388.982875:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154499968:0@lo:400:kworker.0 00000001:02000400:2.0:1788744389.337321:0:14055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:26:28 (1788744388) 00000100:00100000:1.0:1788744389.489556:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744389.489578:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154500480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744389.489643:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744389.489704:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500480 00000100:00100000:1.0:1788744389.489711:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500480 00000100:00100000:1.0:1788744389.489836:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788744389.489847:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154500480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744389.489878:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744389.489922:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154500480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744389.489940:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788744389.489998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154500480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744389.494703:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154500608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744389.494781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744389.498506:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500608 00000100:00100000:2.0:1788744389.498519:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500608 00000100:00100000:3.0:1788744389.498686:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788744389.498699:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154500608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788744389.498726:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744389.498828:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154500608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744389.498835:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788744389.499062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154500608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744389.999057:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744389.999078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154500736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744389.999148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744389.999301:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500736 00000100:00100000:2.0:1788744389.999310:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500736 00000100:00100000:2.0:1788744389.999364:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788744389.999373:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154500736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744389.999433:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744389.999477:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154500736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744389.999484:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:1.0:1788744389.999500:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788744389.999624:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cb53100 x1875634154500736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744389.999642:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154500736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744390.510860:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744390.510884:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154500864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744390.510955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744390.511226:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500864 00000100:00100000:2.0:1788744390.511234:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500864 00000100:00100000:2.0:1788744390.511300:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788744390.511311:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154500864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744390.511333:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744390.511419:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154500864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744390.511426:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1788744390.511443:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac77cdc7b80 x1875634154500864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744390.511462:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154500864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788744390.511490:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744390.667705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744390.667757:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744390.667792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744390.667826:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744390.667848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744390.667854:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676352 00000100:00100000:0.0:1788744390.667863:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676352 00000100:00080000:3.0:1788744390.667898:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744390.667914:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676608 00000100:00100000:0.0:1788744390.667917:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676608 00000100:00100000:3.0:1788744390.667922:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676224 00000100:00100000:3.0:1788744390.667925:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676224 00000100:00100000:0.0:1788744390.667934:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676480 00000100:00100000:0.0:1788744390.667937:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676480 00000100:00100000:3.0:1788744390.667946:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 264 00000100:00100000:2.0:1788744390.668048:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676096 00000100:00100000:2.0:1788744390.668052:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676096 00000100:00100000:2.0:1788744390.668082:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 377 00000100:00100000:2.0:1788744390.668090:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138676096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744390.668162:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2397:x1875634138676096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744390.668170:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 377 00000100:00100000:3.0:1788744390.668223:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138676352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744390.668259:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138676352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 305us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744390.668611:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:0.0:1788744390.668622:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138676608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744390.668656:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138676608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744390.668680:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:0.0:1788744390.668695:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:0.0:1788744390.668702:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138676224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744390.668731:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2397:x1875634138676224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744390.668737:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:0.0:1788744390.668749:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:0.0:1788744390.668756:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138676480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744390.668781:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2397:x1875634138676480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744390.668787:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00080000:0.0:1788744390.668944:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744390.668948:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744390.672138:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 264 00000100:00100000:3.0:1788744390.763184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744390.763302:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676736 00000100:00100000:0.0:1788744390.763312:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676736 00000100:00100000:0.0:1788744390.763378:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:0.0:1788744390.763388:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:11086:x1875634138676736:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744390.763448:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744390.763472:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d418 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744390.763546:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc47e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744390.763560:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc47e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744390.763588:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc47e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744390.763633:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788744390.763637:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744390.763673:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc47e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744390.763696:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d418 expref: 7 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744390.763714:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc47e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d418 expref: 6 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744390.763722:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257100) 00010000:00010000:0.0:1788744390.763725:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744390.763728:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dada00, rc 0) 00000100:00100000:0.0:1788744390.764032:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:11086:x1875634138676736:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 644us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744390.764039:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:0.0:1788744390.773510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744390.774909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676864 00000100:00100000:1.0:1788744390.774925:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676864 00000100:00100000:1.0:1788744390.775008:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1788744390.775020:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:11087:x1875634138676864:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744390.775042:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744390.775063:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775130:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775145:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775158:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775173:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775180:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775186:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775261:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcc49a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775269:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcc49a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775276:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcc49a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744390.775315:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744390.775318:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744390.775339:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcc49a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775348:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775354:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775360:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775367:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744390.775371:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775378:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775388:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257100) 00010000:00010000:1.0:1788744390.775397:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744390.775444:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775452:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc48c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775468:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775474:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775480:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775485:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744390.775488:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775494:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775503:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ac64354d300) 00010000:00010000:1.0:1788744390.775505:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744390.775507:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775512:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc493 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775552:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d41f expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775579:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcc49a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d41f expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744390.775587:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac64354df00) 00010000:00010000:1.0:1788744390.775589:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744390.775592:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170a00, rc 0) 00000100:00100000:1.0:1788744390.775655:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11087:x1875634138676864:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 638us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744390.775663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1788744390.778363:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744390.778656:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138676992 00000100:00100000:1.0:1788744390.778667:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138676992 00000100:00100000:1.0:1788744390.778766:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788744390.778787:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11087:x1875634138676992:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788744390.778877:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11087:x1875634138676992:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 101us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744390.778885:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788744390.787799:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744390.787949:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138677248 00000100:00100000:2.0:1788744390.787960:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138677248 00000100:00100000:2.0:1788744390.788040:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1788744390.788052:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11087:x1875634138677248:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744390.788075:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744390.788096:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc4a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d426 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788170:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788186:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788198:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788255:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788281:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788289:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788453:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc4b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788462:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788469:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744390.788479:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788744390.788565:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788573:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788580:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788586:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744390.788590:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788598:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788622:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac64354df00) 00010000:00010000:2.0:1788744390.788625:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744390.788630:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788636:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc4a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788649:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788655:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788661:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788666:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744390.788669:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788675:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788682:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ac762c95200) 00010000:00010000:2.0:1788744390.788685:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744390.788688:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.788693:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc4af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.790245:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc4a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d426 expref: 10 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.790272:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d426 expref: 9 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744390.790280:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:2.0:1788744390.790283:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744390.790286:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59000, rc 0) 00000100:00100000:2.0:1788744390.790496:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11087:x1875634138677248:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2445us (2717us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788744390.790505:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1788744390.798029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744390.798153:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138677376 00000100:00100000:0.0:1788744390.798164:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138677376 00000100:00100000:0.0:1788744390.798224:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1788744390.798235:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11087:x1875634138677376:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788744390.798340:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11087:x1875634138677376:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744390.798358:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788744390.802559:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744390.802713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138677504 00000100:00100000:2.0:1788744390.802723:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138677504 00000100:00100000:2.0:1788744390.802770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788744390.802791:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:11087:x1875634138677504:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788744390.805896:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3062us 00000100:00100000:3.0:1788744390.820734:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:11087:x1875634138677504:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 17930us (18170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744390.820748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000040:00080000:2.0:1788744390.833253:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788744391.023742:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744391.535795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744391.535818:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154500992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744391.535884:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744391.536020:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154500992 00000100:00100000:0.0:1788744391.536030:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154500992 00000100:00100000:0.0:1788744391.536089:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788744391.536099:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154500992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744391.536136:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744391.536187:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154500992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744391.536194:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788744391.536239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154500992:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788744391.791325:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744392.046626:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744392.562999:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154501120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744392.563086:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744392.563190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154501120 00000100:00100000:2.0:1788744392.566572:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154501120 00000100:00100000:2.0:1788744392.566655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788744392.566665:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154501120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744392.566703:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788744392.566791:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154501120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744392.566801:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788744392.567038:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154501120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744392.655163:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744392.655299:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138677632 00000100:00100000:1.0:1788744392.655308:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138677632 00000100:00100000:1.0:1788744392.655377:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788744392.655388:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11129:x1875634138677632:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744392.655426:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744392.655445:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc4c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d42d expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655521:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655535:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655547:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655562:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655568:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655575:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655627:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655635:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655642:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655647:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744392.655652:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655668:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655680:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257100) 00010000:00010000:1.0:1788744392.655683:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744392.655688:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655693:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc4cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655705:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655711:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655716:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655720:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744392.655723:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655728:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655735:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac64354d300) 00010000:00010000:1.0:1788744392.655737:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744392.655740:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655756:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc4d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655788:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc4c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d42d expref: 10 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655798:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257100) 00010000:00010000:1.0:1788744392.655800:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744392.655803:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc4c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d42d expref: 10 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744392.655815:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782171800, rc 0) 00000100:00100000:1.0:1788744392.655872:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11129:x1875634138677632:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 487us (717us total) trans 0 rc 301/301 00000100:00100000:1.0:1788744392.655880:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00080000:0.0:1788744392.660551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744392.664139:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744392.664551:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138677888 00000100:00100000:3.0:1788744392.664561:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138677888 00000100:00100000:3.0:1788744392.664631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788744392.664642:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11129:x1875634138677888:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1788744392.664698:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744392.664725:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc47e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d418 expref: 9 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.664742:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257100) 00010000:00010000:3.0:1788744392.664754:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744392.664817:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.664830:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.664839:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.664864:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.664871:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.664878:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.666817:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.666838:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.666849:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744392.666869:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d537ecf8 reply state 00000000a05331f0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.666881:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.666888:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744392.666891:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744392.666894:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788744392.666900:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788744392.666907:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.666913:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667011:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667019:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744392.667024:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667032:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667043:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:3.0:1788744392.667046:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744392.667050:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667056:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744392.667077:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d537ecf8 reply state 00000000a05331f0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667086:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.667092:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac744e31300) 00010000:00010000:3.0:1788744392.667095:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744392.667097:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788744392.668268:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:11129:x1875634138677888:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 3617us (4126us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788744392.668280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:0.0:1788744392.761999:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744392.763398:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678016 00000100:00100000:3.0:1788744392.763434:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678016 00000100:00100000:3.0:1788744392.763498:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1788744392.763508:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:11137:x1875634138678016:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:3.0:1788744392.763532:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744392.763553:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d434 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.763828:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcc4f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.763846:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcc4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.763860:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcc4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744392.763903:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788744392.763907:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744392.763947:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcc4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.763980:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc4ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d434 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.763996:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcc4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d434 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.764004:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:3.0:1788744392.764007:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744392.764026:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be200, rc 0) 00000100:00100000:3.0:1788744392.764127:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:11137:x1875634138678016:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 619us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744392.764134:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1788744392.818744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744392.818828:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678144 00000100:00100000:0.0:1788744392.818839:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678144 00000100:00100000:0.0:1788744392.818897:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1788744392.818910:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:11143:x1875634138678144:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744392.818930:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744392.818947:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc4fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d43b expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819027:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819043:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819055:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819083:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819091:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819099:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819204:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad200/0xb6207a6e76dcc511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819212:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad200/0xb6207a6e76dcc511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819220:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad200/0xb6207a6e76dcc511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744392.819258:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788744392.819272:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744392.819310:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad200/0xb6207a6e76dcc511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819323:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819329:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819348:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819365:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744392.819370:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819377:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819389:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:0.0:1788744392.819392:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744392.819397:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819508:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc503 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819523:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819533:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819540:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819546:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744392.819549:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819555:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819572:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac744e31300) 00010000:00010000:0.0:1788744392.819575:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744392.819578:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819583:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc50a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819610:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d43b expref: 13 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819623:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad200/0xb6207a6e76dcc511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d43b expref: 12 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.819630:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744392.819632:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788744392.819634:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad200, rc 0) 00000100:00100000:0.0:1788744392.819700:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:11143:x1875634138678144:12345-192.168.203.4@tcp:101:bash.0 Request processed in 793us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744392.819709:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1788744392.830845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744392.831026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678400 00000100:00100000:3.0:1788744392.831038:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678400 00000100:00100000:3.0:1788744392.831103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1788744392.831113:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:11143:x1875634138678400:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788744392.831132:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744392.831151:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc518 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d442 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.831242:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.831257:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.832338:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.832396:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.832475:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.832484:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744392.832803:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788744392.833020:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833030:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833038:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833070:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833077:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833159:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833166:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744392.833171:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833180:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833192:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744392.833195:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744392.833200:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833206:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc51f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744392.833493:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000009f64c1a reply state 00000000b9579082 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833504:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833511:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:3.0:1788744392.833513:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744392.833516:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788744392.833553:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc518 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833568:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.833575:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:3.0:1788744392.833577:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744392.833579:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf400, rc 0) 00000100:00100000:3.0:1788744392.833649:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:11143:x1875634138678400:12345-192.168.203.4@tcp:101:bash.0 Request processed in 2537us (2814us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788744392.833658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1788744392.837672:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744392.837782:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678528 00000100:00100000:2.0:1788744392.837791:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678528 00000100:00100000:2.0:1788744392.837833:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788744392.837841:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875634138678528:12345-192.168.203.4@tcp:8:bash.0 00010000:00080000:2.0:1788744392.837873:0:8430:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:2.0:1788744392.837903:0:8430:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc53b 00002000:00100000:2.0:1788744392.837913:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e50f0a12-1dec-4e87-aa9a-b50e34f62300/ffff9ac7531fc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744392.837931:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744392.838156:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788744392.838184:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac7531fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744392.838331:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138678528:12345-192.168.203.4@tcp:8:bash.0 Request processed in 488us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744392.838339:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788744392.841037:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744392.841152:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678656 00000100:00100000:0.0:1788744392.841163:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678656 00000100:00100000:0.0:1788744392.841333:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788744392.841343:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138678656:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744392.841363:0:8966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744392.841395:0:8966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d449 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744392.841463:0:8966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744392.841484:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1788744392.841489:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744392.841498:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 7 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.841522:0:8966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 7 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.841539:0:8966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dada00, rc 0) 00000100:00100000:0.0:1788744392.841603:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:0:x1875634138678656:12345-192.168.203.4@tcp:101:bash.0 Request processed in 262us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744392.841611:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00080000:2.0:1788744392.844308:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744392.844341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744392.844491:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678784 00000100:00100000:3.0:1788744392.844502:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678784 00000100:00100000:3.0:1788744392.844619:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1788744392.844629:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11143:x1875634138678784:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788744392.844647:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744392.844679:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d450 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.844710:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 8 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.844719:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744392.844724:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744392.844729:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.844874:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 8 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.844889:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 8 pid: 8966 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744392.844904:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac743253480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875634154501248:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744392.845115:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744392.848480:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744392.848511:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac743253480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875634154501248:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744392.848565:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138678912 00000100:00100000:0.0:1788744392.848573:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138678912 00010000:00010000:0.0:1788744392.848610:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 9 pid: 8966 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744392.848654:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788744392.848664:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138678912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744392.848678:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744392.848698:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 9 pid: 8966 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.848728:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 9 pid: 8966 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.848749:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc542 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d449 expref: 9 pid: 8966 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.848765:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744392.848770:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744392.848778:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.848788:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744392.848822:0:9517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744392.848835:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9517:1875634154501376:192.168.203.4@tcp:105: 00000100:00100000:0.0:1788744392.848911:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788744392.850138:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.850156:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be400, rc 0) 00000100:00100000:2.0:1788744392.850365:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:11143:x1875634138678784:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5735us (6171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744392.850391:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1788744392.853327:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9517:1875634154501376:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788744392.853354:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744392.853444:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138678912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4780us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744392.853456:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1788744392.859152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744392.859241:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138679168 00000100:00100000:1.0:1788744392.859253:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138679168 00000100:00100000:1.0:1788744392.859312:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788744392.859323:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:11143:x1875634138679168:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1788744392.859697:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11143:x1875634138679168:12345-192.168.203.4@tcp:35:bash.0 Request processed in 373us (865us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788744392.859706:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788744392.940489:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744392.940619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138679424 00000100:00100000:3.0:1788744392.940642:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138679424 00000100:00100000:3.0:1788744392.940702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788744392.940713:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11153:x1875634138679424:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744392.940737:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744392.940757:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d457 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744392.940860:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788744392.940967:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc550 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d457 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.940981:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:3.0:1788744392.940984:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744392.940989:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d457 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744392.941003:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf200, rc 0) 00000100:00100000:3.0:1788744392.941063:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:11153:x1875634138679424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 352us (583us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788744392.941071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788744392.943256:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744392.943441:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138679680 00000100:00100000:0.0:1788744392.943451:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138679680 00000100:00100000:0.0:1788744392.943511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788744392.943522:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:11153:x1875634138679680:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788744392.943719:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:11153:x1875634138679680:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 199us (470us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788744392.943727:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788744393.000502:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.000589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138679808 00000100:00100000:0.0:1788744393.000600:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138679808 00000100:00100000:0.0:1788744393.000664:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788744393.000676:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:11159:x1875634138679808:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744393.000704:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744393.000724:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc55e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d45e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.000863:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.000878:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.000888:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744393.000932:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788744393.000950:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744393.000980:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.001006:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc55e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d45e expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.001025:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d45e expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.001033:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744393.001036:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744393.001039:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac200, rc 0) 00000100:00100000:0.0:1788744393.001142:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:11159:x1875634138679808:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 468us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744393.001149:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:3.0:1788744393.010997:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.011354:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138680064 00000100:00100000:1.0:1788744393.011367:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138680064 00000100:00100000:1.0:1788744393.011496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1788744393.011508:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:11159:x1875634138680064:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744393.011539:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744393.011569:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc56c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d465 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.011713:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc573 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.011727:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.011739:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744393.011751:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788744393.012297:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc56c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d465 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.012319:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc573 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d465 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.012327:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:1.0:1788744393.012331:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744393.012334:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170200, rc 0) 00000100:00100000:1.0:1788744393.012507:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:11159:x1875634138680064:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1000us (1754us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788744393.012515:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1788744393.017650:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.018342:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138680320 00000100:00100000:0.0:1788744393.018355:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138680320 00000100:00100000:0.0:1788744393.021821:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:0.0:1788744393.021842:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:11159:x1875634138680320:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744393.021867:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788744393.021875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1788744393.021887:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc581 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d46c expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.022002:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc588 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.022016:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.022044:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744393.022058:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788744393.022151:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc581 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d46c expref: 24 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.022170:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc588 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d46c expref: 23 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.022177:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:0.0:1788744393.022180:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744393.022184:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac600, rc 0) 00000100:00100000:0.0:1788744393.022240:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:11159:x1875634138680320:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 408us (4600us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788744393.022247:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:1.0:1788744393.022313:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138680448 00000100:00100000:1.0:1788744393.022321:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138680448 00000100:00100000:1.0:1788744393.022363:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788744393.022371:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:2395:x1875634138680448:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744393.022380:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744393.022419:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc573 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d465 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.022432:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:1.0:1788744393.022450:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744393.022491:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:2395:x1875634138680448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 121us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744393.022498:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788744393.030207:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.032507:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138680576 00000100:00100000:0.0:1788744393.032523:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138680576 00000100:00100000:0.0:1788744393.032596:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1788744393.032608:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138680576:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1788744393.032986:0:8966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.033008:0:8966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.033017:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744393.033035:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744393.033039:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.033077:0:8966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.033093:0:8966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 7 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744393.033107:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8966:1875634154501504:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744393.033247:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744393.036066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.036084:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8966:1875634154501504:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744393.036113:0:8966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744393.036201:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138680704 00000100:00100000:1.0:1788744393.036209:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138680704 00002000:00100000:1.0:1788744393.036251:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9ac743948a80 x1875634138680704/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:669/0 lens 504/0 e 0 to 0 dl 1788744404 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744393.036261:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac743948a80 with x1875634138680704 ext(0->12) 00010000:00010000:1.0:1788744393.036268:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.036282:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 8 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744393.036290:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac743948a80 00000100:00100000:1.0:1788744393.036321:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744393.036330:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138680704:12345-192.168.203.4@tcp:4:lfs.0 00000001:00100000:3.0:1788744393.040580:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000100:00100000:1.0:1788744393.043280:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138680704:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 6940us (7214us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788744393.043295:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:1.0:1788744393.043307:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9ac743948a80 x1875634138680704/t4294967300(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:669/0 lens 504/448 e 0 to 0 dl 1788744404 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744393.043331:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac743948a80 with x1875634138680704 ext(0->12) 00010000:00010000:1.0:1788744393.043341:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.043360:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744393.043368:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac743948a80 00000100:00100000:3.0:1788744393.050584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.051293:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138680832 00000100:00100000:1.0:1788744393.051305:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138680832 00010000:00010000:1.0:1788744393.051346:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744393.051389:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:1.0:1788744393.051397:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2396:x1875634138680832:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744393.051434:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788744393.051449:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788744393.051452:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788744393 00002000:00010000:1.0:1788744393.051454:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788744393 00002000:00010000:1.0:1788744393.051456:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788744393 00002000:00010000:1.0:1788744393.051458:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788744393.051464:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.051476:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.051507:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cbef0f0/0xb6207a6e76dcc549 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d450 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.051644:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744393.051649:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744393.051655:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.051664:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.051688:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744393.053242:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2396:x1875634138680832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1835us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744393.053256:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00010000:00010000:0.0:1788744393.053453:0:8966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053468:0:8966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053495:0:8966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053503:0:8966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053527:0:8966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053534:0:8966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744393.053539:0:8966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053548:0:8966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053565:0:8966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.053573:0:8966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcc596 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744393.053649:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138680576:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 21042us (23449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744393.053658:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:3.0:1788744393.059492:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.059656:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138681088 00000100:00100000:0.0:1788744393.059667:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138681088 00000100:00100000:0.0:1788744393.062047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788744393.062080:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11159:x1875634138681088:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:0.0:1788744393.062155:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc588 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d46c expref: 22 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744393.062374:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788744393.062458:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788744393.062754:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788744393.063048:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.063065:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.063075:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.063121:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.063137:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 26 pid: 6517 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744393.063150:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875634154501632:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744393.063223:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744393.065954:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875634154501632:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744393.065996:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744393.066890:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.067092:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138681216 00000100:00100000:0.0:1788744393.067110:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138681216 00010000:00010000:0.0:1788744393.067148:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 27 pid: 6517 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744393.067196:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:0.0:1788744393.067205:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:2394:x1875634138681216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744393.067221:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744393.067228:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 27 pid: 6517 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067239:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 27 pid: 6517 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067260:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc52d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d442 expref: 27 pid: 6517 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067275:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:0.0:1788744393.067281:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067289:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067297:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067320:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744393.067372:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+26:2394:x1875634138681216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 167us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744393.067379:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00010000:00010000:0.0:1788744393.067426:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.067440:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744393.067540:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788744393.067635:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788744393.067716:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154501760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788744393.067782:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744393.067814:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9480 going to sleep for 11 seconds 00010000:00010000:2.0:1788744393.070706:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744393.076625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154501760 00000100:00100000:1.0:1788744393.076643:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154501760 00000100:00100000:1.0:1788744393.076737:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788744393.076749:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875634154501760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788744393.076880:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875634154501760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (9097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744393.076887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788744393.076971:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154501760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788744393.077153:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788744393.077227:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753048a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154501888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788744393.077274:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744393.077437:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac748b1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744393.077454:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154501888 00000100:00100000:1.0:1788744393.077459:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154501888 00000100:00100000:1.0:1788744393.077485:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788744393.077493:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875634154501888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788744393.077591:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1875634154501888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (316us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788744393.077597:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788744393.077627:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753048a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154501888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788744393.077667:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788744393.077701:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.077711:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.077718:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.077724:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744393.077728:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.077736:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.077749:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:1.0:1788744393.077752:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788744393.077764:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.077771:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc59d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744393.077860:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788744393.077921:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788744393.077931:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374759529089ns, next at 375759527148ns, rc = 0 00000001:00080000:1.0:1788744393.077938:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788744393.077970:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac74505f700) 00010000:00010000:1.0:1788744393.077974:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744393.077981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc588 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d46c expref: 30 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744393.078047:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744393.078072:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:11159:x1875634138681088:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 16008us (18590us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788744393.078082:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000020:00080000:1.0:1788744393.078086:0:6518:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788744393.081482:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.082869:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138681344 00000100:00100000:1.0:1788744393.082883:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138681344 00000100:00100000:1.0:1788744393.082989:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788744393.083001:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:11159:x1875634138681344:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744393.083024:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744393.083048:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc5a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d473 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.083113:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d473 expref: 30 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.084095:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d473 expref: 30 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.088851:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744393.088861:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744393.088866:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170e00, rc 0) 00000100:00100000:2.0:1788744393.089039:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11159:x1875634138681344:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 6034us (7559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744393.089049:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788744393.103554:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744393.103701:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138681600 00000100:00100000:2.0:1788744393.103712:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138681600 00000100:00100000:1.0:1788744393.103851:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788744393.103864:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750213450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11159:x1875634138681600:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788744393.104192:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750213450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+31:11159:x1875634138681600:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 329us (646us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788744393.104201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788744393.185332:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.185446:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138681856 00000100:00100000:1.0:1788744393.185456:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138681856 00000100:00100000:1.0:1788744393.185509:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788744393.185520:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+31:11169:x1875634138681856:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744393.185543:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744393.185562:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc5ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d47a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744393.185660:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788744393.185747:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc5ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d47a expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.185760:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:1.0:1788744393.185763:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744393.185768:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc5ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d47a expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.185798:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782171800, rc 0) 00000100:00100000:1.0:1788744393.185855:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11169:x1875634138681856:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 336us (531us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788744393.185862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788744393.196541:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.196691:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138681984 00000100:00100000:0.0:1788744393.196702:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138681984 00000100:00100000:0.0:1788744393.196770:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1788744393.196780:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11169:x1875634138681984:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1788744393.196862:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.196879:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.196891:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.196903:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.196910:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.196917:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197011:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197020:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197027:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744393.197071:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197084:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197091:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197383:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197390:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744393.197393:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197426:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197439:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744393.197442:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744393.197447:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197460:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc5b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197476:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197482:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197488:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197493:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744393.197496:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197502:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197509:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:0.0:1788744393.197512:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744393.197526:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197533:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197543:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197548:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197560:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197566:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744393.197569:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197574:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197582:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744393.197584:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744393.197587:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.197593:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744393.197672:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11169:x1875634138681984:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 891us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744393.197680:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:3.0:1788744393.200172:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.200334:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138682240 00000100:00100000:1.0:1788744393.200343:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138682240 00000100:00100000:1.0:1788744393.200431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788744393.200442:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11169:x1875634138682240:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788744393.200649:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:11169:x1875634138682240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 209us (483us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788744393.200658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788744393.237395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744393.238072:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138682496 00000100:00100000:2.0:1788744393.238083:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138682496 00000100:00100000:2.0:1788744393.238145:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1788744393.238155:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:11172:x1875634138682496:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744393.238179:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744393.238198:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc5ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d481 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238269:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238284:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238296:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238320:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238327:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238334:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238459:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238468:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238475:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744393.238485:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788744393.238685:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238693:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238699:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238705:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744393.238710:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238729:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238742:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744393.238745:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744393.238750:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238882:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc5d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238898:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238904:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238911:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238916:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744393.238919:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238926:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238934:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:2.0:1788744393.238937:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744393.238940:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.238967:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc5dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.239013:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc5ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 36 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.239028:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 35 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.239037:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744393.239039:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744393.239042:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744393.239109:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11172:x1875634138682496:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 955us (1724us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788744393.239116:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1788744393.242399:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744393.242687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138682624 00000100:00100000:2.0:1788744393.242697:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138682624 00000100:00100000:2.0:1788744393.242754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788744393.242764:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11172:x1875634138682624:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1788744393.242953:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.242980:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.242992:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243042:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243049:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243055:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243061:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744393.243066:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243073:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243085:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744393.243088:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744393.243092:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.243174:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc5f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744393.243286:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11172:x1875634138682624:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 522us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744393.243294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:3.0:1788744393.247906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.248044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138682880 00000100:00100000:0.0:1788744393.248054:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138682880 00000100:00100000:0.0:1788744393.248111:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788744393.248121:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11172:x1875634138682880:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788744393.248342:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:11172:x1875634138682880:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 222us (445us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788744393.248350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788744393.488754:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.489653:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138683136 00000100:00100000:0.0:1788744393.489666:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138683136 00000100:00100000:0.0:1788744393.489729:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1788744393.489740:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:11203:x1875634138683136:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788744393.489829:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744393.489850:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d488 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.490021:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.490036:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.490050:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744393.490063:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788744393.490184:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc5f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d488 expref: 39 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.490204:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d488 expref: 38 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.490212:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744393.490215:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744393.490218:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac800, rc 0) 00000100:00100000:0.0:1788744393.490348:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11203:x1875634138683136:12345-192.168.203.4@tcp:101:cat.0 Request processed in 609us (1602us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788744393.490371:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788744393.493268:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.493347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138683392 00000100:00100000:0.0:1788744393.493356:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138683392 00000100:00100000:0.0:1788744393.493442:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788744393.493453:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11203:x1875634138683392:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:0.0:1788744393.493679:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:11203:x1875634138683392:12345-192.168.203.4@tcp:35:cat.0 Request processed in 225us (417us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788744393.493686:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788744393.497924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.498007:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138683520 00000100:00100000:1.0:1788744393.498017:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138683520 00000100:00100000:1.0:1788744393.498085:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788744393.498096:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:2394:x1875634138683520:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744393.498112:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744393.498135:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc5ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d488 expref: 39 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.498155:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744393.498159:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744393.498234:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:2394:x1875634138683520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744393.498242:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788744393.576320:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744393.576436:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138683776 00000100:00100000:2.0:1788744393.576446:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138683776 00000100:00100000:2.0:1788744393.576522:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788744393.576546:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11209:x1875634138683776:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1788744393.576571:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744393.576574:0:10509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744393.576598:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d45e expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.576619:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744393.576624:0:10509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744393.576638:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc60d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d48f expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.576735:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.576749:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 38 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.576768:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.576801:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 38 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.576815:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 38 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744393.576839:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154502016:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744393.576931:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744393.582325:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154502016:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744393.582355:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744393.586652:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.589570:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138683904 00000100:00100000:1.0:1788744393.589588:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138683904 00010000:00010000:1.0:1788744393.589635:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 39 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744393.589773:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788744393.589785:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:2394:x1875634138683904:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744393.589800:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744393.589807:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 39 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.589821:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 39 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.589843:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcc5e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d481 expref: 39 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.589861:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744393.589865:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.589875:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.589882:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.589921:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744393.589999:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:2394:x1875634138683904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744393.590021:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00010000:00010000:2.0:1788744393.590084:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.590092:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744393.590110:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788744393.590257:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc60d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 39 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.590272:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 38 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.590279:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744393.590281:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744393.590284:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58c00, rc 0) 00000100:00100000:2.0:1788744393.590308:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11209:x1875634138683776:12345-192.168.203.4@tcp:101:dd.0 Request processed in 13766us (13999us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788744393.590315:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788744393.597789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.597974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138684032 00000100:00100000:0.0:1788744393.597985:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138684032 00000100:00100000:0.0:1788744393.598039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1788744393.598049:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11209:x1875634138684032:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1788744393.598071:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744393.598089:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc622 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d496 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.598122:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.598135:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.598147:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.598476:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.598496:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.598504:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744393.598507:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744393.598511:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad600, rc 0) 00000100:00100000:0.0:1788744393.598625:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:11209:x1875634138684032:12345-192.168.203.4@tcp:101:dd.0 Request processed in 577us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744393.598633:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1788744393.603749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.603837:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138684288 00000100:00100000:0.0:1788744393.603848:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138684288 00000100:00100000:0.0:1788744393.603912:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1788744393.603922:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:11209:x1875634138684288:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1788744393.604136:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.604152:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.604164:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744393.604217:0:7792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788744393.604238:0:7792:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c870a89e reply state 00000000a9846693 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.604268:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.604275:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744393.604278:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744393.604281:0:7792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744393.604642:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:11209:x1875634138684288:12345-192.168.203.4@tcp:36:dd.0 Request processed in 720us (899us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788744393.604650:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000020:00080000:0.0:1788744393.604655:0:7792:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788744393.843445:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744393.843544:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138684416 00000100:00100000:2.0:1788744393.843554:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138684416 00000100:00100000:2.0:1788744393.843626:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1788744393.843637:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:11223:x1875634138684416:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:2.0:1788744393.843660:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744393.843679:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d49d expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843740:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843760:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843771:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843784:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843790:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843797:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843861:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843872:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 43 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843880:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843909:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 43 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.843933:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 43 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744393.843967:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154502144:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744393.844072:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744393.850044:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.850207:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138684672 00000100:00100000:1.0:1788744393.850217:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138684672 00000100:00100000:1.0:1788744393.850280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788744393.850291:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+44:6163:x1875634138684672:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788744393.850625:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+45:6163:x1875634138684672:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 335us (589us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788744393.850634:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788744393.851230:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154502144:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744393.851254:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744393.854818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744393.854933:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138684800 00000100:00100000:0.0:1788744393.854943:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138684800 00010000:00010000:0.0:1788744393.854990:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 45 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744393.855035:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1788744393.855045:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+45:2395:x1875634138684800:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744393.855060:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744393.855066:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 45 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.855080:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 45 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.855123:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc614 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d48f expref: 45 pid: 10509 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.855140:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744393.855145:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.855155:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.855163:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744393.855197:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744393.855251:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+44:2395:x1875634138684800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 208us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744393.855258:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00010000:00010000:2.0:1788744393.855527:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855536:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744393.855586:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788744393.855591:0:10509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744393.855630:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855643:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855652:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855659:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855666:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855671:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744393.855676:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855695:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855705:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744393.855707:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744393.855711:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855717:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc63e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855728:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855735:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855742:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855747:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744393.855749:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855756:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855763:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:2.0:1788744393.855766:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744393.855769:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855784:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855815:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d49d expref: 44 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855828:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d49d expref: 43 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744393.855836:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744393.855839:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744393.855841:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59800, rc 0) 00000100:00100000:2.0:1788744393.855872:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:11223:x1875634138684416:12345-192.168.203.4@tcp:101:stat.0 Request processed in 12237us (12436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744393.855879:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788744393.933671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744393.933757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138685056 00000100:00100000:1.0:1788744393.933769:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138685056 00000100:00100000:1.0:1788744393.933837:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1788744393.933848:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:11229:x1875634138685056:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:1.0:1788744393.933927:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744393.933966:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc64c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d49d expref: 43 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.933985:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744393.933990:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744393.934167:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.934182:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.934192:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744393.934252:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788744393.934277:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f5162e31 reply state 00000000219d297c transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.934289:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744393.934295:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744393.934298:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744393.934300:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744393.934488:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+45:11229:x1875634138685056:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 641us (825us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788744393.934496:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000020:00080000:1.0:1788744393.934501:0:6517:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788744394.095240:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744394.101794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154502528:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.101866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744394.101946:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75304ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154503040:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.101981:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744394.102008:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154503552:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102029:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744394.102053:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788744394.102060:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154502656:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102081:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744394.102101:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac743253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154503168:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102134:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744394.102151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154503680:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102172:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744394.102205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503040 00000100:00100000:3.0:1788744394.102212:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503040 00000100:00100000:3.0:1788744394.102256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503552 00000100:00100000:3.0:1788744394.102260:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503552 00000100:00100000:3.0:1788744394.102279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154502656 00000100:00100000:3.0:1788744394.102283:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154502656 00000100:00100000:3.0:1788744394.102299:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788744394.102308:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154503040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102372:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154503040:12345-0@lo:400:kworker.0 Request processed in 65us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.102379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788744394.102396:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788744394.102433:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154503552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102462:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154503552:12345-0@lo:400:kworker.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.102467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788744394.102481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788744394.102487:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154502656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.102513:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154502656:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.102519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788744394.102554:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154502656:0@lo:400:kworker.0 00010000:00080000:3.0:1788744394.102569:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75304ad80 x1875634154503040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744394.102587:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75304ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154503040:0@lo:400:kworker.0 00010000:00080000:3.0:1788744394.102600:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745077100 x1875634154503552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744394.102609:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154503552:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.102839:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154502400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.102871:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744394.102897:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154502912:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.102929:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744394.102958:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154503424:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.102981:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744394.103005:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788744394.103011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154502272:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103037:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744394.103064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac753049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154502784:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744394.103106:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac743253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154503296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103127:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744394.103144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154503808:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103165:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788744394.103191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744394.103218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154502528 00000100:00100000:2.0:1788744394.103222:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154502528 00000100:00100000:2.0:1788744394.103248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154502784 00000100:00100000:2.0:1788744394.103251:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154502784 00000100:00100000:2.0:1788744394.103265:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744394.103270:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154502528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103313:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154502528:12345-0@lo:400:kworker.0 Request processed in 43us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744394.103347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744394.103353:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154502784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103383:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154502784:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744394.103439:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503168 00000100:00100000:2.0:1788744394.103443:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503168 00000100:00100000:2.0:1788744394.103466:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503680 00000100:00100000:2.0:1788744394.103469:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503680 00000100:00100000:2.0:1788744394.103479:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503296 00000100:00100000:2.0:1788744394.103481:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503296 00000100:00100000:2.0:1788744394.103489:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503808 00000100:00100000:2.0:1788744394.103498:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503808 00000100:00100000:2.0:1788744394.103517:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788744394.103522:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154503168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103555:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154503168:12345-0@lo:400:kworker.0 Request processed in 32us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103561:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788744394.103573:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788744394.103578:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154503680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103605:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154503680:12345-0@lo:400:kworker.0 Request processed in 27us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103611:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788744394.103622:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788744394.103628:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154503296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103668:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154503296:12345-0@lo:400:kworker.0 Request processed in 41us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103674:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788744394.103686:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744394.103692:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154503808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103718:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154503808:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103723:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788744394.103738:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744394.103741:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744394.103779:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154502784:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103789:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac743253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154503296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103810:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154503808:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103841:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac743253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154503168:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103851:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154503680:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103860:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154502528:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154502400 00000100:00100000:2.0:1788744394.103886:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154502400 00000100:00100000:2.0:1788744394.103902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154502912 00000100:00100000:2.0:1788744394.103905:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154502912 00000100:00100000:2.0:1788744394.103923:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154503424 00000100:00100000:2.0:1788744394.103926:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154503424 00000100:00100000:2.0:1788744394.103940:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788744394.103945:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154502400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.103993:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154502400:12345-0@lo:400:kworker.0 Request processed in 47us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.103999:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788744394.104011:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788744394.104017:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154502912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.104043:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154502912:12345-0@lo:400:kworker.0 Request processed in 27us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.104049:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788744394.104060:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788744394.104065:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154503424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.104090:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154503424:12345-0@lo:400:kworker.0 Request processed in 25us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.104095:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1788744394.104115:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744394.104133:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154502400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.104143:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154502912:0@lo:400:kworker.0 00000100:00100000:2.0:1788744394.104152:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154503424:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.104438:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154502272 00000100:00100000:3.0:1788744394.104444:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154502272 00000100:00100000:3.0:1788744394.104468:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788744394.104475:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154502272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.104526:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154502272:12345-0@lo:400:kworker.0 Request processed in 51us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.104532:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788744394.104566:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac753049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154502272:0@lo:400:kworker.0 00000100:00100000:3.0:1788744394.126657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.127461:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138685184 00000100:00100000:2.0:1788744394.127474:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138685184 00000100:00100000:2.0:1788744394.127675:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1788744394.127687:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+45:11243:x1875634138685184:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:2.0:1788744394.127714:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744394.127735:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc65a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127798:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127814:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127825:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127836:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127844:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127851:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127964:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127974:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.127980:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744394.128020:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788744394.128025:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744394.128044:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128056:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128065:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128071:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128078:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128084:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.128088:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128094:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128112:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744394.128115:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.128121:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128127:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc661 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128141:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128147:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128153:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128158:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.128160:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128166:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128173:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:2.0:1788744394.128175:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.128178:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128184:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128221:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc65a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128235:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 46 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.128242:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744394.128244:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744394.128247:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59a00, rc 0) 00000100:00100000:2.0:1788744394.128320:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+46:11243:x1875634138685184:12345-192.168.203.4@tcp:101:stat.0 Request processed in 634us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.128327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00080000:0.0:1788744394.131894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744394.243423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.243597:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138685440 00000100:00100000:2.0:1788744394.243607:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138685440 00000100:00100000:2.0:1788744394.243671:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1788744394.243683:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+46:11253:x1875634138685440:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744394.243704:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744394.243727:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4ab expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744394.243828:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788744394.243920:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc676 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ab expref: 48 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.243934:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:2.0:1788744394.243937:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744394.243969:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ab expref: 48 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.243984:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58200, rc 0) 00000100:00100000:2.0:1788744394.244051:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:11253:x1875634138685440:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 370us (659us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788744394.244059:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1788744394.248092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.248185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138685696 00000100:00100000:2.0:1788744394.248196:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138685696 00000100:00100000:2.0:1788744394.248259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788744394.248269:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:11253:x1875634138685696:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744394.248676:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+48:11253:x1875634138685696:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 407us (591us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788744394.248685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788744394.333062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744394.333259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138685952 00000100:00100000:1.0:1788744394.333268:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138685952 00000100:00100000:1.0:1788744394.333322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1788744394.333330:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+48:11259:x1875634138685952:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788744394.333351:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744394.333370:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc684 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.333495:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.333519:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.333545:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.333575:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.333595:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 49 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744394.333609:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745074700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154503936:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744394.333734:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744394.343091:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744394.343189:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745074700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154503936:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744394.343216:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744394.343365:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138686080 00000100:00100000:3.0:1788744394.343372:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138686080 00010000:00010000:3.0:1788744394.343432:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 50 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744394.343468:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1788744394.343478:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+50:2395:x1875634138686080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744394.343492:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744394.343499:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 50 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.343541:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 50 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.343564:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc66f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4a4 expref: 50 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.343579:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744394.343584:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.343603:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.343611:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.343638:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744394.343695:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:2395:x1875634138686080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 218us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.343702:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00010000:00010000:1.0:1788744394.344186:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.344196:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744394.344216:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788744394.344339:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcc684 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.344356:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.344376:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744394.344378:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744394.344381:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535e00, rc 0) 00000100:00100000:1.0:1788744394.344459:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:11259:x1875634138685952:12345-192.168.203.4@tcp:101:bash.0 Request processed in 11129us (11404us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788744394.344466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1788744394.351629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.351860:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138686336 00000100:00100000:3.0:1788744394.351871:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138686336 00000100:00100000:3.0:1788744394.351935:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1788744394.351956:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:11259:x1875634138686336:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:3.0:1788744394.352184:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.352204:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.352230:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744394.352274:0:7792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788744394.352294:0:7792:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000011597218 reply state 000000008bf4e969 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.352308:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.352315:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744394.352318:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744394.352322:0:7792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744394.352455:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:11259:x1875634138686336:12345-192.168.203.4@tcp:36:bash.0 Request processed in 510us (837us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788744394.352463:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000020:00080000:3.0:1788744394.352468:0:7792:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788744394.377247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744394.377964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138686464 00000100:00100000:0.0:1788744394.377976:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138686464 00000100:00100000:0.0:1788744394.378039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788744394.378049:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:11259:x1875634138686464:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744394.378073:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744394.378106:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcc6a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4b9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.378196:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.378211:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.378221:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.378255:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.378268:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 53 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744394.378282:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154504064:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744394.378755:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744394.382359:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.382532:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb50380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154504064:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744394.382559:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744394.383684:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138686592 00000100:00100000:1.0:1788744394.383696:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138686592 00010000:00010000:1.0:1788744394.383740:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 54 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744394.383841:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1788744394.383867:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:2395:x1875634138686592:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744394.383889:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744394.383897:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 54 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.383909:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 54 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.383929:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcc68b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b2 expref: 54 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.383946:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744394.383961:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.383988:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.383997:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.384033:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744394.384107:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:2395:x1875634138686592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 256us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744394.384115:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00010000:00010000:3.0:1788744394.384191:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.384199:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744394.384251:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788744394.384255:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744394.384285:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.384315:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcc6a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b9 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.384331:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b9 expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.384338:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744394.384340:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744394.384343:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad400, rc 0) 00000100:00100000:3.0:1788744394.384371:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:11259:x1875634138686464:12345-192.168.203.4@tcp:101:bash.0 Request processed in 6324us (7134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.384377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1788744394.395439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744394.395554:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138686848 00000100:00100000:0.0:1788744394.395564:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138686848 00000100:00100000:0.0:1788744394.395671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788744394.395684:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750210850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:11259:x1875634138686848:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1788744394.395942:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750210850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:11259:x1875634138686848:12345-192.168.203.4@tcp:35:bash.0 Request processed in 260us (547us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788744394.395960:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788744394.510250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744394.510352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138687104 00000100:00100000:1.0:1788744394.510364:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138687104 00000100:00100000:1.0:1788744394.510457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788744394.510468:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:11269:x1875634138687104:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744394.510492:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744394.510511:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcc6ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744394.510606:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788744394.510713:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcc6ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4c0 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.510727:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:1.0:1788744394.510730:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744394.510735:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcc6ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4c0 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.510750:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741534a00, rc 0) 00000100:00100000:1.0:1788744394.510838:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11269:x1875634138687104:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 372us (599us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788744394.510845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788744394.514786:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.514873:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138687232 00000100:00100000:2.0:1788744394.514884:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138687232 00000100:00100000:2.0:1788744394.514970:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1788744394.514981:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11269:x1875634138687232:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1788744394.515232:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515252:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515264:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515274:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515294:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515302:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515381:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515390:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.515396:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744394.516115:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516131:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516137:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516143:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516149:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744394.516153:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516175:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516188:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744394.516191:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744394.516197:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516203:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc6bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516218:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516224:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516230:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516235:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744394.516238:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516244:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516251:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:3.0:1788744394.516254:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744394.516257:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516274:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc6c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516286:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516292:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516297:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516301:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744394.516304:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516310:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516316:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744394.516319:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744394.516322:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.516327:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc6ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744394.518334:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11269:x1875634138687232:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 3341us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.518349:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1788744394.522544:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.522654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138687488 00000100:00100000:2.0:1788744394.522665:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138687488 00000100:00100000:2.0:1788744394.522723:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788744394.522733:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11269:x1875634138687488:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744394.522975:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:11269:x1875634138687488:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 242us (439us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788744394.522983:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788744394.581466:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.581536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138687744 00000100:00100000:3.0:1788744394.581548:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138687744 00000100:00100000:3.0:1788744394.581612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:3.0:1788744394.581624:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:11272:x1875634138687744:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744394.581650:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744394.581670:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc6d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.581743:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.581871:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.581885:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.581897:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.581904:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.581910:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582025:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc6e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582034:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582059:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744394.582071:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788744394.582690:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582700:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582707:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582713:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744394.582717:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582724:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.582735:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744394.582738:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744394.582742:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583081:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc6d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583095:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583101:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583115:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583120:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfe00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744394.583123:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583128:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583136:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:3.0:1788744394.583138:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744394.583141:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583146:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc6df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583601:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc6d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4c7 expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583618:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4c7 expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.583626:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744394.583628:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744394.583630:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be000, rc 0) 00000100:00100000:3.0:1788744394.583825:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+57:11272:x1875634138687744:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2202us (2367us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788744394.583843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1788744394.589328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744394.589436:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.589577:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138688000 00000100:00100000:2.0:1788744394.589586:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138688000 00000100:00100000:2.0:1788744394.589657:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788744394.589668:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+57:2394:x1875634138688000:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744394.589683:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744394.589719:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc6e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4c7 expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.589737:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744394.589742:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744394.589802:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:2394:x1875634138688000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.589810:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788744394.590809:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138687872 00000100:00100000:3.0:1788744394.590818:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138687872 00000100:00100000:0.0:1788744394.591077:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:0.0:1788744394.591088:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:11272:x1875634138687872:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788744394.591146:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591168:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591180:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591213:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591221:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591233:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591239:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744394.591243:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591251:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591261:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744394.591264:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744394.591268:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.591287:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc6f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744394.591395:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:11272:x1875634138687872:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 308us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744394.591422:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:1.0:1788744394.596298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.596668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138688256 00000100:00100000:2.0:1788744394.596678:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138688256 00000100:00100000:2.0:1788744394.596738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788744394.596748:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:11272:x1875634138688256:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744394.597106:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+57:11272:x1875634138688256:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 358us (815us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788744394.597114:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788744394.607848:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744394.607873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154504192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744394.607940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744394.608125:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154504192 00000100:00100000:1.0:1788744394.608135:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154504192 00000100:00100000:1.0:1788744394.608190:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788744394.608200:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154504192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744394.608233:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744394.608283:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154504192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744394.608290:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788744394.608340:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154504192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744394.608489:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744394.608498:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154504320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744394.608531:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744394.608706:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154504320 00000100:00100000:1.0:1788744394.608711:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154504320 00000100:00100000:1.0:1788744394.608729:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788744394.608735:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154504320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744394.608746:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744394.608781:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154504320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744394.608787:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788744394.609023:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154504320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744394.728794:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.728873:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138688512 00000100:00100000:3.0:1788744394.728884:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138688512 00000100:00100000:3.0:1788744394.728955:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1788744394.728966:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+57:11290:x1875634138688512:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:3.0:1788744394.728988:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744394.729008:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc6fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4ce expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.729104:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc702 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.729117:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.729128:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744394.729138:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788744394.729241:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc6fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ce expref: 60 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.729260:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ce expref: 59 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.729268:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744394.729284:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788744394.729288:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfe00, rc 0) 00000100:00100000:3.0:1788744394.729354:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11290:x1875634138688512:12345-192.168.203.4@tcp:101:cat.0 Request processed in 389us (568us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788744394.729362:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:0.0:1788744394.761616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.761783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138688640 00000100:00100000:3.0:1788744394.761794:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138688640 00000100:00100000:3.0:1788744394.761855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:3.0:1788744394.761865:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11291:x1875634138688640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744394.761888:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744394.761907:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4d5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.762002:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc717 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.762016:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.762028:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744394.762073:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788744394.762076:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744394.762093:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.762117:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4d5 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.762153:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4d5 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.762161:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744394.762164:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744394.762167:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:3.0:1788744394.762229:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11291:x1875634138688640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 365us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.762236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1788744394.768336:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.768920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689024 00000100:00100000:2.0:1788744394.768930:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689024 00000100:00100000:2.0:1788744394.769003:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1788744394.769017:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11291:x1875634138689024:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744394.770017:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11291:x1875634138689024:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 998us (1683us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788744394.770027:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788744394.775352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744394.779056:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689152 00000100:00100000:0.0:1788744394.779122:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689152 00000100:00100000:0.0:1788744394.779199:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788744394.779208:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11291:x1875634138689152:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1788744394.779224:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788744394.779245:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc6a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4b9 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.779266:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc702 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ce expref: 60 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.779279:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcc5a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d473 expref: 59 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.779305:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744394.779310:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744394.779556:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11291:x1875634138689152:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 346us (4212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744394.779564:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788744394.782212:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.782918:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689280 00000100:00100000:2.0:1788744394.782942:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689280 00000100:00100000:2.0:1788744394.783057:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1788744394.783068:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11291:x1875634138689280:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:2.0:1788744394.783184:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.783199:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.783210:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744394.783440:0:7792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744394.783595:0:7792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788744394.783695:0:7792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788744394.783780:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11291:x1875634138689280:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 713us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.783789:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1788744394.806836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.806994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689408 00000100:00100000:2.0:1788744394.807005:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689408 00000100:00100000:2.0:1788744394.807059:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1788744394.807068:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11294:x1875634138689408:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744394.807088:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744394.807107:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc725 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807172:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807187:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807208:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807219:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807226:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807231:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807305:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807314:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807321:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744394.807361:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788744394.807365:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744394.807384:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807397:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807449:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807465:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807472:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807477:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.807481:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807489:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807501:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744394.807504:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.807509:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807515:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc72c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807529:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807689:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807696:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807701:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.807710:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807716:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807724:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:2.0:1788744394.807727:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.807730:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807735:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc733 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807832:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc725 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807847:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.807854:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744394.807857:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744394.807859:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59e00, rc 0) 00000100:00100000:2.0:1788744394.807911:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11294:x1875634138689408:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 844us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.807918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000040:00080000:3.0:1788744394.863303:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744394.863314:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744394.863361:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788744394.863371:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744394.863540:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154504448:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744394.863706:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744394.871298:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154504448:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744394.877328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.877509:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689536 00000100:00100000:2.0:1788744394.877526:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689536 00000100:00100000:2.0:1788744394.877588:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788744394.877599:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11305:x1875634138689536:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744394.877644:0:6515:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744394.877767:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11305:x1875634138689536:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 169us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.877774:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1788744394.889372:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.889820:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689664 00000100:00100000:2.0:1788744394.889832:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689664 00000100:00100000:2.0:1788744394.889890:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1788744394.889901:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11305:x1875634138689664:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788744394.889999:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890016:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890028:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890086:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890095:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890103:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890129:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890139:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890153:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744394.890198:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788744394.890202:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744394.890215:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890226:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890233:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890241:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890246:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.890250:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890259:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890271:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:2.0:1788744394.890274:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.890279:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890285:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc741 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890309:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890316:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890322:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890327:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.890330:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890336:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890343:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9ac76020cc00) 00010000:00010000:2.0:1788744394.890346:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.890349:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890355:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc748 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890370:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890376:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890382:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890393:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.890396:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890506:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890516:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744394.890645:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.890650:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.890656:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc74f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744394.890744:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11305:x1875634138689664:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 844us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.890753:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:0.0:1788744394.894735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744394.894936:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138689920 00000100:00100000:1.0:1788744394.894958:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138689920 00000100:00100000:1.0:1788744394.895069:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1788744394.895093:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11305:x1875634138689920:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744394.895115:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744394.895133:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcc756 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895238:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895252:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895263:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744394.895276:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788744394.895351:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895360:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895367:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895373:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744394.895378:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895396:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895451:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744394.895454:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744394.895459:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895466:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc75d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895505:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcc756 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4e3 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895516:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:1.0:1788744394.895518:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744394.895522:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcc756 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4e3 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744394.895532:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535400, rc 0) 00000100:00100000:1.0:1788744394.895590:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11305:x1875634138689920:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 500us (869us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788744394.895598:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1788744394.909860:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.914875:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138690048 00000100:00100000:3.0:1788744394.914888:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138690048 00000100:00100000:3.0:1788744394.914960:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1788744394.914971:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11305:x1875634138690048:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788744394.915006:0:10509:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788744394.915132:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11305:x1875634138690048:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 162us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.915141:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1788744394.928849:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.929743:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138690304 00000100:00100000:2.0:1788744394.929754:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138690304 00000100:00100000:0.0:1788744394.929936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788744394.929959:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11305:x1875634138690304:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744394.929981:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744394.929984:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788744394.930008:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc717 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4d5 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.930026:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744394.930031:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744394.930044:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc76b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744394.930443:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788744394.930605:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc772 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.930619:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.930636:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.930690:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc76b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ea expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.930705:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ea expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.930712:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac642257600) 00010000:00010000:0.0:1788744394.930715:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744394.930718:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac000, rc 0) 00000100:00100000:0.0:1788744394.930784:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11305:x1875634138690304:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 838us (1943us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788744394.930792:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:1.0:1788744394.936866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.940513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138690560 00000100:00100000:2.0:1788744394.940534:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138690560 00000100:00100000:2.0:1788744394.940627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:2.0:1788744394.940639:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11305:x1875634138690560:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744394.940718:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744394.940755:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc772 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ea expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940800:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac642257600) 00010000:00010000:2.0:1788744394.940814:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744394.940844:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940861:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940873:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940890:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940898:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940904:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940970:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940978:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940985:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.940991:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.940996:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941011:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941020:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744394.941023:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.941028:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941034:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc780 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941046:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941052:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941058:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941064:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744394.941067:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941073:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941081:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x4e3dd9f6 (ffff9ac76020cc00) 00010000:00010000:2.0:1788744394.941083:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744394.941086:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744394.941103:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc787 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4e3dd9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744394.941225:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11305:x1875634138690560:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 586us (4372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744394.941234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:0.0:1788744394.947292:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.948216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138690688 00000100:00100000:3.0:1788744394.948235:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138690688 00000100:00100000:3.0:1788744394.948323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1788744394.948337:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11305:x1875634138690688:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744394.948368:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744394.948435:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc78e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4f1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.948485:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.948502:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.948517:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.948678:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc78e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.948701:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.948712:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744394.948715:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744394.948719:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:3.0:1788744394.948814:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11305:x1875634138690688:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 479us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744394.948822:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1788744394.953265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.953623:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138690944 00000100:00100000:3.0:1788744394.953635:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138690944 00000100:00100000:3.0:1788744394.953726:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:3.0:1788744394.953744:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11305:x1875634138690944:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744394.953834:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.953853:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.953867:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744394.954065:0:7792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788744394.954092:0:7792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376635689280ns, next at 377635685132ns, rc = 0 00000004:00010000:3.0:1788744394.954167:0:7792:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000fed13dc reply state 00000000bc923764 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.954182:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744394.954190:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744394.954194:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788744394.954198:0:7792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744394.954322:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:11305:x1875634138690944:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 582us (1068us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788744394.954333:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1788744394.962211:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.965194:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138691072 00000100:00100000:3.0:1788744394.965211:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138691072 00000100:00100000:0.0:1788744394.965350:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1788744394.972124:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:11305:x1875634138691072:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744394.972175:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744394.972204:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4f8 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.972284:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 64 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.972335:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 64 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744394.972360:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:0.0:1788744394.972363:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744394.972367:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac600, rc 0) 00000100:00100000:0.0:1788744394.972484:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:11305:x1875634138691072:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 391us (10282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744394.972975:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1788744394.980855:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.981882:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138691200 00000100:00100000:2.0:1788744394.981899:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138691200 00000100:00100000:2.0:1788744394.982098:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788744394.982110:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875634138691200:12345-192.168.203.4@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788744394.982155:0:8432:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:2.0:1788744394.982199:0:8432:0:(genops.c:1384:class_connect()) connect: client e50f0a12-1dec-4e87-aa9a-b50e34f62300, cookie 0xb6207a6e76dcc7aa 00002000:00100000:2.0:1788744394.982214:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e50f0a12-1dec-4e87-aa9a-b50e34f62300/ffff9ac77f7d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744394.982227:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744394.982351:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744394.982392:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ac77f7d4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744394.982516:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2393:x1875634138691200:12345-192.168.203.4@tcp:8:lhsmtool_posix.0 Request processed in 405us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744394.982525:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1788744394.985062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744394.985150:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138691328 00000100:00100000:3.0:1788744394.985163:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138691328 00000100:00100000:3.0:1788744394.985259:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:3.0:1788744394.985272:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:0:x1875634138691328:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788744394.985512:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788744394.991288:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1788744394.991301:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000100:00100000:2.0:1788744394.991636:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:0:x1875634138691328:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 6354us (6573us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788744394.991653:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788744394.997220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744394.997333:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138691584 00000100:00100000:2.0:1788744394.997348:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138691584 00000100:00100000:2.0:1788744394.997457:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788744394.997478:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:11305:x1875634138691584:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744394.997903:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:11305:x1875634138691584:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 427us (694us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788744394.997912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788744395.007089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744395.007189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138691840 00000100:00100000:3.0:1788744395.007203:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138691840 00000100:00100000:3.0:1788744395.007273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:3.0:1788744395.007284:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:11305:x1875634138691840:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744395.007447:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:11305:x1875634138691840:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 164us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744395.007455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1788744395.013487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744395.013714:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138691968 00000100:00100000:2.0:1788744395.013728:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138691968 00000100:00100000:2.0:1788744395.013807:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:2.0:1788744395.013820:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:11305:x1875634138691968:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744395.013847:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744395.013873:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc7b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d4ff expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.013975:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc7b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.013993:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.014008:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744395.014065:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744395.014102:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.014141:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc7b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ff expref: 67 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.014162:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ff expref: 66 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.014185:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:2.0:1788744395.014188:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744395.014192:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59600, rc 0) 00000100:00100000:2.0:1788744395.014268:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:11305:x1875634138691968:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 451us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744395.014276:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:1.0:1788744395.019193:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744395.019285:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692096 00000100:00100000:3.0:1788744395.019299:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692096 00000100:00100000:3.0:1788744395.019378:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1788744395.019391:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138692096:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744395.019440:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744395.019468:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d506 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744395.019502:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e12cb, blocks: 0x0 00010000:00010000:3.0:1788744395.019530:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1788744395.019536:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744395.019547:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.019571:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.019601:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf200, rc 0) 00000100:00100000:3.0:1788744395.019672:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138692096:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 283us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744395.019680:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788744395.022393:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.022621:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692352 00000100:00100000:0.0:1788744395.022634:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692352 00000100:00100000:0.0:1788744395.022705:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1788744395.022718:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:11305:x1875634138692352:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744395.022956:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:11305:x1875634138692352:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 230us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.022965:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1788744395.034761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.035377:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692480 00000100:00100000:0.0:1788744395.035389:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692480 00000100:00100000:0.0:1788744395.035482:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788744395.035496:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:11305:x1875634138692480:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744395.035530:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744395.035555:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d50d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.035614:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.035625:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744395.035631:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744395.035638:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.035684:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.035701:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.035719:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875634154504576:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744395.036179:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744395.041189:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875634154504576:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744395.041237:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.041263:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac200, rc 0) 00000100:00100000:2.0:1788744395.041375:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11305:x1875634138692480:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 5880us (6628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744395.041385:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1788744395.042899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744395.043766:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692608 00000100:00100000:3.0:1788744395.043779:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692608 00010000:00010000:3.0:1788744395.043831:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.043875:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788744395.043887:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138692608:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744395.043904:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744395.043930:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.043957:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.043985:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcc7bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d506 expref: 7 pid: 8431 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.044004:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744395.044008:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744395.044037:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.044047:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.044095:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.044111:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1875634154504704:192.168.203.4@tcp:105: 00000100:00100000:3.0:1788744395.044204:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744395.048716:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6501:1875634154504704:192.168.203.4@tcp:105: 00010000:00010000:3.0:1788744395.048755:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744395.048823:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138692608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4936us (5933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744395.048838:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788744395.049649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744395.050916:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692736 00000100:00100000:1.0:1788744395.050933:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692736 00002000:00100000:1.0:1788744395.051005:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ac745072a00 x1875634138692736/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:671/0 lens 504/0 e 0 to 0 dl 1788744406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744395.051018:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac745072a00 with x1875634138692736 ext(0->8) 00002000:00010000:1.0:1788744395.051025:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac745072a00 00000100:00100000:1.0:1788744395.051061:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744395.051072:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138692736:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788744395.052374:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138692736:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1292us (2717us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788744395.052389:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:1.0:1788744395.052492:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ac745072a00 x1875634138692736/t4294967303(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:671/0 lens 504/448 e 0 to 0 dl 1788744406 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744395.052506:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac745072a00 with x1875634138692736 ext(0->8) 00002000:00010000:1.0:1788744395.052513:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac745072a00 00000100:00100000:0.0:1788744395.061848:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744395.064355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692864 00000100:00100000:2.0:1788744395.064377:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692864 00000100:00100000:2.0:1788744395.064791:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:2.0:1788744395.064806:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:11305:x1875634138692864:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788744395.069370:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788744395.069387:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788744395.069482:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788744395.069500:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac748b1d000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788744395.069506:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac775b7ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac748b1df00 00000020:00080000:1.0:1788744395.069524:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac775b7e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac775b86800 00000100:00100000:0.0:1788744395.069656:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154504832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788744395.069695:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11305:x1875634138692864:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 4888us (7856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744395.069707:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:0.0:1788744395.069756:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744395.069852:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154504832 00000100:00100000:0.0:1788744395.069873:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154504832 00000100:00100000:0.0:1788744395.069938:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744395.069960:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154504832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788744395.070122:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788744395.070133:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788744395 00002000:00010000:0.0:1788744395.070135:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788744395.070138:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788744395 -> 1788744395 00002000:00010000:0.0:1788744395.070141:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788744395.070200:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875634154504832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (458us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788744395.070209:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:0.0:1788744395.070254:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac643354e00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788744395.070261:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154504832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788744395.070758:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744395.070771:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154504960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788744395.070814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744395.070850:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154504960 00000100:00100000:2.0:1788744395.070856:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154504960 00000100:00080000:1.0:1788744395.070887:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744395.070907:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788744395.070927:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154504960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788744395.070961:0:8430:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788744395.070994:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e12c9, atime: 0x6a9e12c9, ctime: 0x6a9e12c9, blocks: 0x8 00010000:00010000:2.0:1788744395.071003:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.071023:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788744395.071027:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744395.071034:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.071077:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.071090:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.071098:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.071123:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744395.071154:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744395.071164:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.071179:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744395.071183:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.071197:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.071222:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.071231:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcc7cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.071260:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744395.071263:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744395.071266:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744395.071289:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875634154504960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 362us (473us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788744395.071298:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788744395.071338:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac6424c0000/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788744395.071344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154504960:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788744395.072027:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788744395.072225:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788744395.073607:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073644:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073655:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073662:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bec00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.073667:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073675:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073696:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac744e31300) 00010000:00010000:2.0:1788744395.073700:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744395.073705:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073712:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcc4e0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073738:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073756:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073762:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073767:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.073777:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073783:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073792:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744395.073795:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744395.073798:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073803:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dcc4e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073821:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073828:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073833:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073838:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfa00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.073841:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073846:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073854:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac744e31d00) 00010000:00010000:2.0:1788744395.073856:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744395.073866:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073872:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcc526 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073891:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073897:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073903:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073908:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.073911:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073917:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073926:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744395.073928:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744395.073931:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073937:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc630 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073960:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073967:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073979:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073984:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782171800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.073987:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.073993:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074001:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744395.074004:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744395.074006:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074013:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcc653 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074027:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074033:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074038:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074043:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.074046:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074062:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074071:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744395.074073:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744395.074076:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074082:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcc699 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074095:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074102:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074109:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074115:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfe00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744395.074118:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074125:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074134:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:2.0:1788744395.074137:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788744395.074140:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.074157:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc79c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.077880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.077963:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138692992 00000100:00100000:0.0:1788744395.077979:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138692992 00000100:00100000:0.0:1788744395.078044:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788744395.078057:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138692992:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788744395.080325:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788744395.080341:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788744395.085725:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138692992:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 7654us (7836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.085742:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788744395.097844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744395.098019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138693248 00000100:00100000:3.0:1788744395.098033:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138693248 00000100:00100000:3.0:1788744395.098125:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1788744395.098138:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:11305:x1875634138693248:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744395.098232:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744395.098354:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc7b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4ff expref: 14 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.098380:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744395.098387:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744395.098480:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.098498:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.098509:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744395.098816:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002bfdbb11 reply state 00000000b641bd7d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.098832:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.098840:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744395.098843:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744395.098847:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744395.100308:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:11305:x1875634138693248:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2156us (2461us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788744395.100323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:2.0:1788744395.104824:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.104970:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138693376 00000100:00100000:0.0:1788744395.104983:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138693376 00000100:00100000:0.0:1788744395.105059:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1788744395.105073:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138693376:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788744395.105290:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788744395.105294:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788744395 -> 1788744395 00002000:00010000:0.0:1788744395.105296:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788744393 00002000:00010000:0.0:1788744395.105299:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788744395 -> 1788744395 00002000:00010000:0.0:1788744395.105301:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788744395.105380:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138693376:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 310us (572us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788744395.109726:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788744395.113009:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.113746:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138693632 00000100:00100000:0.0:1788744395.113760:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138693632 00000100:00100000:0.0:1788744395.113848:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:0.0:1788744395.113861:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:11305:x1875634138693632:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788744395.113961:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.113981:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.113992:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.114036:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.114052:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 15 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.114069:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154505088:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744395.114203:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744395.118918:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154505216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744395.119022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744395.119148:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154505216 00000100:00100000:0.0:1788744395.119160:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154505216 00010000:00010000:3.0:1788744395.119214:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744395.119235:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788744395.119252:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154505216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744395.119292:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788744395.119375:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154505216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.119383:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788744395.119591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154505216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744395.129518:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744395.129958:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138693760 00000100:00100000:3.0:1788744395.129970:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138693760 00010000:00010000:3.0:1788744395.130040:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 16 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.130094:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1788744395.130106:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:2395:x1875634138693760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744395.130131:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744395.130138:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 16 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.130154:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 16 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.130181:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744395.130187:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.130197:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.130206:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.130229:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744395.130294:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:2395:x1875634138693760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 190us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744395.130303:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00010000:00010000:0.0:1788744395.130694:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f1 expref: 15 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.130711:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154505088:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744395.130800:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130813:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130820:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130871:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130879:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130885:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130891:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744395.130897:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130905:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130929:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:0.0:1788744395.130933:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788744395.130938:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.130955:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.131006:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:11305:x1875634138693632:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 17147us (18010us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788744395.131015:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1788744395.136827:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744395.136996:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138693888 00000100:00100000:1.0:1788744395.137009:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138693888 00000100:00100000:1.0:1788744395.137082:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1788744395.137096:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2397:x1875634138693888:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788744395.137159:0:8966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.137186:0:8966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.137196:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744395.137201:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744395.137206:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.137249:0:8966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.137264:0:8966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 7 pid: 8432 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.137282:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8966:1875634154505344:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744395.137394:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744395.142348:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744395.142486:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8966:1875634154505344:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744395.142599:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138694016 00000100:00100000:0.0:1788744395.142609:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138694016 00010000:00010000:0.0:1788744395.142659:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 8 pid: 8432 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.142686:0:8966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.142711:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1788744395.142722:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138694016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744395.142757:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744395.142786:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 8 pid: 8432 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.142801:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 8 pid: 8432 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.142829:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcc7c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d50d expref: 8 pid: 8432 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.142858:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744395.142863:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744395.142869:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.142879:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.142910:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744395.142961:0:8966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.142970:0:8966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.142990:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138694016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 266us (655us total) trans 0 rc 0/0 00010000:00010000:1.0:1788744395.142994:0:8966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.142999:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00010000:00010000:1.0:1788744395.143003:0:8966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.143012:0:8966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.143020:0:8966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744395.143025:0:8966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.143035:0:8966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.143053:0:8966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.143067:0:8966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000800a2585/0xb6207a6e76dcc7e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.143124:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2397:x1875634138693888:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 6031us (6313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744395.143132:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:3.0:1788744395.149695:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.149916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138694272 00000100:00100000:0.0:1788744395.149988:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138694272 00000100:00100000:0.0:1788744395.150102:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:0.0:1788744395.150116:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:11305:x1875634138694272:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788744395.150231:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.150252:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.150262:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.150317:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.150356:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 14 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744395.150382:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154505472:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744395.150522:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744395.155454:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744395.155507:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154505472:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744395.155536:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138694400 00010000:00010000:1.0:1788744395.155545:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.155547:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138694400 00010000:00010000:3.0:1788744395.155613:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 15 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.155662:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1788744395.155674:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:2395:x1875634138694400:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744395.155693:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744395.155702:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 15 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.155716:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 15 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.155761:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d496 expref: 15 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.155781:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744395.155787:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.155798:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.155807:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.155839:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744395.155870:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.155880:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.155909:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2395:x1875634138694400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 236us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744395.155917:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00010000:00010000:1.0:1788744395.157019:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.157040:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 14 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.157051:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.157089:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 14 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.157120:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 14 pid: 10509 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.157137:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154505600:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744395.157626:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744395.168004:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154505600:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744395.168031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1788744395.168044:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.168268:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138694528 00000100:00100000:1.0:1788744395.168277:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138694528 00010000:00010000:1.0:1788744395.168332:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 15 pid: 10509 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.168429:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1788744395.168440:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:2394:x1875634138694528:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744395.168456:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744395.168738:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 15 pid: 10509 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.168765:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 15 pid: 10509 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.168792:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dcc7a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4f8 expref: 15 pid: 10509 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.168822:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:1.0:1788744395.168829:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.168854:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.168863:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.169005:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744395.169073:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2394:x1875634138694528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 635us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744395.169083:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00010000:00010000:3.0:1788744395.169168:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.169178:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744395.169320:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788744395.169488:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788744395.169529:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788744395.169626:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875634154505728:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788744395.169694:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744395.169748:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744395.171841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154505728 00000100:00100000:2.0:1788744395.171859:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154505728 00000100:00100000:2.0:1788744395.172084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788744395.172096:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1875634154505728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744395.172268:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1875634154505728:12345-0@lo:1000:mdt00_002.0 Request processed in 174us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744395.172276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744395.172655:0:6517:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788744395.172663:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac643354e00, transno 4294967304 00000100:00100000:3.0:1788744395.172690:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875634154505728:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788744395.173058:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788744395.173154:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875634154505856:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788744395.174876:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744395.175143:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac755600a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744395.175861:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154505856 00000100:00100000:1.0:1788744395.175873:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154505856 00000100:00100000:1.0:1788744395.176097:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788744395.176110:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1875634154505856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744395.176340:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1875634154505856:12345-0@lo:1000:mdt00_002.0 Request processed in 232us (1835us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788744395.176350:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788744395.176457:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875634154505856:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788744395.176527:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176538:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176561:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176568:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744395.176573:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176582:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176600:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744395.176604:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744395.176609:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176616:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcc7f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176656:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176663:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176669:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176675:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744395.176679:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176695:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176704:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744395.176706:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744395.176710:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176716:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc71e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176755:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176774:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176784:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176825:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.176842:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 17 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.176858:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154505984:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744395.176973:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac755600a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744395.183269:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154505984:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744395.183329:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744395.196562:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744395.196836:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138694656 00000100:00100000:1.0:1788744395.196851:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138694656 00010000:00010000:1.0:1788744395.196924:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 18 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.196980:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1788744395.196993:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2394:x1875634138694656:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744395.197012:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744395.197020:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 18 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.197299:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 18 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.197329:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc73a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d4dc expref: 18 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.197349:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744395.197356:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.197377:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.197387:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.197499:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744395.197573:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:2394:x1875634138694656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 582us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744395.197582:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00010000:00010000:3.0:1788744395.198446:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198461:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198481:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198489:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198498:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198505:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744395.198511:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198520:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198536:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744395.198539:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744395.198544:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198550:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc7f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198594:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198600:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198605:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198611:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744395.198614:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198621:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198639:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744395.198642:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744395.198645:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744395.198651:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc7e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744395.199076:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11305:x1875634138694272:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 48958us (49384us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788744395.199276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00000020:00080000:2.0:1788744395.199284:0:6517:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788744395.199728:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744395.199735:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744395.199756:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788744395.199764:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744395.202175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744395.210834:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138694912 00000100:00100000:2.0:1788744395.210857:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138694912 00000100:00100000:2.0:1788744395.210968:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788744395.210982:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11305:x1875634138694912:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788744395.211659:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788744395.211852:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788744395.211896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.211918:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.211931:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.211941:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.211959:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.211966:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.211995:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744395.212039:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744395.212049:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.212058:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744395.212062:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.212073:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.212115:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:1.0:1788744395.212119:0:9528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788744395.212129:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.212136:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcc7fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744395.212151:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744395.212153:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744395.212155:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744395.212224:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:11305:x1875634138694912:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1188us (10007us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788744395.212237:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000020:00080000:2.0:1788744395.212243:0:6519:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788744395.631255:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154506112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744395.631352:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744395.631721:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154506112 00000100:00100000:0.0:1788744395.631733:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154506112 00000100:00100000:0.0:1788744395.631807:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788744395.631820:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875634154506112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744395.631853:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788744395.633379:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875634154506112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1552us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.633394:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788744395.639104:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154506112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744395.788414:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.788488:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.788563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.788614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.788646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.788686:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695168 00000100:00100000:0.0:1788744395.788701:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695168 00000100:00100000:0.0:1788744395.788784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695424 00000100:00100000:0.0:1788744395.788788:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695424 00000100:00100000:0.0:1788744395.788812:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695552 00000100:00100000:0.0:1788744395.788815:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695552 00000100:00100000:0.0:1788744395.788835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:0.0:1788744395.788846:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138695168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744395.788972:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138695168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 127us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.788981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:0.0:1788744395.789001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00100000:0.0:1788744395.789008:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138695424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744395.789035:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138695424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.789041:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00100000:0.0:1788744395.789053:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:0.0:1788744395.789060:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138695552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744395.789093:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138695552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.789100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:0.0:1788744395.789125:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695040 00000100:00100000:0.0:1788744395.789129:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695040 00000100:00100000:0.0:1788744395.789155:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 379 00000100:00100000:0.0:1788744395.789162:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138695040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744395.789185:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138695040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.789191:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 379 00000100:00100000:0.0:1788744395.789222:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695296 00000100:00100000:0.0:1788744395.789225:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695296 00000100:00100000:0.0:1788744395.789255:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1788744395.789261:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138695296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744395.789295:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138695296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744395.789302:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00080000:0.0:1788744395.789324:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744395.789329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744395.789332:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788744395.797104:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744395.797118:0:14203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744395.797146:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788744395.797153:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744395.959582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744395.964379:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695808 00000100:00100000:2.0:1788744395.964398:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695808 00000100:00100000:2.0:1788744395.964542:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1788744395.964554:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:11315:x1875634138695808:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744395.964606:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744395.964633:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc805 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d514 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.964791:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc80c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.964812:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc80c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.964829:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc80c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744395.964844:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788744395.966777:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcc805 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d514 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.966817:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc80c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d514 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744395.966828:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744395.966832:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744395.966836:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58800, rc 0) 00000100:00100000:2.0:1788744395.966957:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11315:x1875634138695808:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2403us (7388us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788744395.966967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:3.0:1788744395.974034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744395.974692:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138695936 00000100:00100000:0.0:1788744395.974707:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138695936 00000100:00100000:0.0:1788744395.974945:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:0.0:1788744395.974958:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11315:x1875634138695936:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1788744395.975067:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975090:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975105:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975121:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975128:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975134:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975234:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975254:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975261:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744395.975318:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975332:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975338:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975345:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975352:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744395.975356:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975365:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975377:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744395.975380:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744395.975386:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975393:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc81a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975437:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975443:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975449:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975454:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744395.975457:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975464:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975482:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257300) 00010000:00010000:0.0:1788744395.975485:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744395.975488:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.975493:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc821 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979637:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979658:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979666:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979685:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744395.979691:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979698:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979719:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257a00) 00010000:00010000:0.0:1788744395.979722:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744395.979832:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744395.979840:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744395.980071:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11315:x1875634138695936:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 5108us (6049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744395.980083:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:1.0:1788744396.027034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.027632:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138696192 00000100:00100000:0.0:1788744396.027647:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138696192 00000100:00100000:0.0:1788744396.027728:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:0.0:1788744396.027742:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11318:x1875634138696192:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744396.027774:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.027801:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc82f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d51b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.027905:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.027924:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.027950:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.027984:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.027992:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.027999:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028143:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028151:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028159:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744396.028170:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788744396.028296:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028304:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028312:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028318:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.028323:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028343:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028358:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744396.028361:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.028368:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028374:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028388:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028394:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028426:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028433:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.028436:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028441:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028449:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257a00) 00010000:00010000:0.0:1788744396.028452:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.028454:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.028484:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc83d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744396.028500:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788744396.029816:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc82f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.029843:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.029853:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.029856:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744396.029859:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac000, rc 0) 00000100:00100000:0.0:1788744396.030140:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11318:x1875634138696192:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2399us (3201us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788744396.030154:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:3.0:1788744396.035105:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.035144:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138696320 00000100:00100000:0.0:1788744396.035158:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138696320 00000100:00100000:0.0:1788744396.035229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:0.0:1788744396.035241:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11318:x1875634138696320:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788744396.035341:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.035365:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.035382:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.035479:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.035487:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.035493:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.036014:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.036021:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.036030:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.036046:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.036050:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744396.036056:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.036063:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744396.036255:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11318:x1875634138696320:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 1009us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744396.036266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:1.0:1788744396.040655:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.040906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138696576 00000100:00100000:2.0:1788744396.040921:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138696576 00000100:00100000:2.0:1788744396.041033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788744396.041046:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750213050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11318:x1875634138696576:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744396.041352:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750213050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:11318:x1875634138696576:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 308us (709us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788744396.041361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788744396.079117:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.079237:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138696832 00000100:00100000:0.0:1788744396.079248:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138696832 00000100:00100000:0.0:1788744396.079312:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1788744396.079323:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:10844:x1875634138696832:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.079352:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.079375:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc859 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d522 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.079682:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.079699:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.079708:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.079742:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.079756:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 24 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.079769:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154506240:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744396.079911:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744396.089659:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154506240:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744396.089688:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744396.092869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744396.093226:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138696960 00000100:00100000:3.0:1788744396.093236:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138696960 00010000:00010000:3.0:1788744396.093279:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 25 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744396.093376:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1788744396.093388:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:2395:x1875634138696960:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744396.093449:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744396.093457:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 25 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.093470:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 25 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.093489:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc844 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d51b expref: 25 pid: 6517 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.093752:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:3.0:1788744396.093759:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.093768:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.093790:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.093827:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744396.093890:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:2395:x1875634138696960:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 505us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744396.093899:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00010000:00010000:0.0:1788744396.093968:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.093976:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744396.093994:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788744396.094128:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcc859 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 25 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.094144:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 24 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.094151:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.094154:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744396.094156:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac800, rc 0) 00000100:00100000:0.0:1788744396.094181:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:10844:x1875634138696832:12345-192.168.203.4@tcp:101:bash.0 Request processed in 14861us (15075us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788744396.094188:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:1.0:1788744396.102092:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.102174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138697088 00000100:00100000:0.0:1788744396.102184:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138697088 00000100:00100000:0.0:1788744396.102240:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:0.0:1788744396.102249:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:10844:x1875634138697088:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.102274:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.102292:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc86e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d529 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.102326:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.102339:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.102350:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.102825:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc86e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d529 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.102845:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d529 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.102853:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.102856:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744396.102859:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dadc00, rc 0) 00000100:00100000:0.0:1788744396.102921:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:10844:x1875634138697088:12345-192.168.203.4@tcp:101:bash.0 Request processed in 673us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.102928:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:1.0:1788744396.108439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744396.110372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138697344 00000100:00100000:3.0:1788744396.110393:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138697344 00000100:00100000:3.0:1788744396.110501:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:3.0:1788744396.110514:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:10844:x1875634138697344:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:3.0:1788744396.112196:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.112228:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.112244:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744396.112311:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788744396.112345:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b09ff277 reply state 0000000031be8054 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.112360:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.112369:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:3.0:1788744396.112373:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744396.112397:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788744396.112471:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788744396.112895:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:10844:x1875634138697344:12345-192.168.203.4@tcp:36:bash.0 Request processed in 2374us (4484us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788744396.112909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000020:00080000:2.0:1788744396.112915:0:6515:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788744396.115820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.115931:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138697472 00000100:00100000:0.0:1788744396.115954:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138697472 00000100:00100000:0.0:1788744396.116016:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:0.0:1788744396.116027:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:10844:x1875634138697472:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.116052:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.116072:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc883 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d530 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.116330:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc883 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d530 expref: 30 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.116347:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc883 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d530 expref: 30 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.116381:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.116385:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744396.116389:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad000, rc 0) 00000100:00100000:0.0:1788744396.116732:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:10844:x1875634138697472:12345-192.168.203.4@tcp:101:bash.0 Request processed in 706us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.116803:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:1.0:1788744396.122512:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.122616:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138697600 00000100:00100000:0.0:1788744396.122630:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138697600 00000100:00100000:0.0:1788744396.122724:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:0.0:1788744396.122754:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:10844:x1875634138697600:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.122780:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.122808:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d537 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744396.122843:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e12cb, atime: 0x6a9e12c9, ctime: 0x6a9e12cb, blocks: 0x8 00010000:00010000:0.0:1788744396.122962:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1788744396.122969:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744396.122979:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.123003:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.123020:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad400, rc 0) 00000100:00100000:0.0:1788744396.123155:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:10844:x1875634138697600:12345-192.168.203.4@tcp:101:bash.0 Request processed in 404us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.123186:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00080000:2.0:1788744396.124161:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744396.139000:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744396.139213:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138697728 00000100:00100000:3.0:1788744396.139226:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138697728 00002000:00010000:3.0:1788744396.139284:0:8435:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788744396.139290:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643e92300 with x1875634138697728 ext(0->18446744073709551615) 00002000:00010000:3.0:1788744396.139306:0:8435:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643e92300. 00000100:00100000:3.0:1788744396.139346:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788744396.139357:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138697728:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:2.0:1788744396.140272:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788744396.140280:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788744395 -> 1788744397 00002000:00010000:2.0:1788744396.140282:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788744393 -> 1788744393 00002000:00010000:2.0:1788744396.140285:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788744395 -> 1788744397 00002000:00010000:2.0:1788744396.140287:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788744396.140376:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138697728:12345-192.168.203.4@tcp:10:bash.0 Request processed in 1017us (1385us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788744396.140391:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00010000:2.0:1788744396.140397:0:8435:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788744396.140428:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643e92300 with x1875634138697728 ext(0->18446744073709551615) 00002000:00010000:2.0:1788744396.140435:0:8435:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643e92300. 00010000:00010000:1.0:1788744396.142634:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744396.206759:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744396.206773:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744396.206799:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788744396.206812:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744396.241529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.241718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138697856 00000100:00100000:2.0:1788744396.241732:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138697856 00000100:00100000:2.0:1788744396.241811:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:2.0:1788744396.241824:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11332:x1875634138697856:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1788744396.241931:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.241977:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.241992:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242011:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242019:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242026:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242129:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242140:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242148:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744396.242207:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242222:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242229:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242249:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242256:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.242261:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242269:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242282:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744396.242286:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.242291:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242303:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc891 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242319:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242325:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242330:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242336:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.242339:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.242355:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.244514:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac76020c400) 00010000:00010000:2.0:1788744396.244519:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.244527:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.244575:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.244608:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.244620:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.244627:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.249478:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.249507:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.249524:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.249581:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:2.0:1788744396.249586:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.249592:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.249632:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc89f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.250316:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11332:x1875634138697856:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 8486us (8793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.250329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:1.0:1788744396.279535:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.279668:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138698112 00000100:00100000:2.0:1788744396.279683:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138698112 00000100:00100000:2.0:1788744396.279757:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:2.0:1788744396.279769:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11335:x1875634138698112:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744396.279797:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744396.279823:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc8a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d53e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.279950:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.279969:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.279984:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280001:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280009:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280029:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280171:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc8bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280181:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc8bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280190:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc8bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744396.280202:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788744396.280307:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280316:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280324:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280331:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.280336:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280346:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280362:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744396.280368:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.280388:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280397:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc8ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280461:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280468:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280475:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280481:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.280485:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280490:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280499:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac76020c400) 00010000:00010000:2.0:1788744396.280501:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.280504:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280510:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcc8b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280560:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcc8a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d53e expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280588:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc8bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d53e expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.280597:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:2.0:1788744396.280599:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744396.280602:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59800, rc 0) 00000100:00100000:2.0:1788744396.280673:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11335:x1875634138698112:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 906us (1152us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788744396.280682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:3.0:1788744396.283227:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.283865:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138698240 00000100:00100000:0.0:1788744396.283883:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138698240 00000100:00100000:0.0:1788744396.284780:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:0.0:1788744396.284795:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11335:x1875634138698240:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788744396.284888:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.284928:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 32 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.284950:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.284996:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 32 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.285012:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 32 pid: 10509 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.285029:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154506368:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744396.285151:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744396.292235:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154506368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744396.292727:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744396.297615:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.298139:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138698496 00000100:00100000:2.0:1788744396.298154:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138698496 00000100:00100000:2.0:1788744396.298240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788744396.298252:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:6162:x1875634138698496:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788744396.299105:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:6162:x1875634138698496:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 848us (1499us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788744396.299136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788744396.305110:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.305244:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138698624 00000100:00100000:2.0:1788744396.305258:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138698624 00010000:00010000:2.0:1788744396.305389:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 34 pid: 10509 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.305605:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1788744396.305618:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:2395:x1875634138698624:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744396.305639:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744396.305648:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 34 pid: 10509 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.305664:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 34 pid: 10509 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.305709:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc860 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d522 expref: 34 pid: 10509 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.305731:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:2.0:1788744396.305864:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.305878:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.305888:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.306195:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744396.306270:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:2395:x1875634138698624:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 653us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.306285:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00010000:00010000:0.0:1788744396.306367:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306377:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306454:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306462:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306469:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306476:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.306481:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306491:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306514:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.306517:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744396.306522:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.306529:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.306592:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11335:x1875634138698240:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 21802us (23376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.306600:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:1.0:1788744396.315161:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.315306:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138698880 00000100:00100000:0.0:1788744396.315321:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138698880 00000100:00100000:0.0:1788744396.315583:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788744396.315596:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:11335:x1875634138698880:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788744396.316217:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:11335:x1875634138698880:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 620us (1068us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788744396.316227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1788744396.383833:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.387071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138699136 00000100:00100000:2.0:1788744396.387086:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138699136 00000100:00100000:3.0:1788744396.388065:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:3.0:1788744396.388078:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:11346:x1875634138699136:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:3.0:1788744396.388104:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744396.388125:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc8d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d545 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388203:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388221:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388238:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388339:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388347:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388354:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388690:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc8e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388701:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.388707:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744396.388716:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788744396.390558:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390573:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390580:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390586:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744396.390591:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390617:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390633:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744396.390636:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744396.390641:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390648:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcc8d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390662:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390668:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390674:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390679:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744396.390682:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390687:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390694:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac74505fe00) 00010000:00010000:3.0:1788744396.390696:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744396.390698:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390713:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcc8de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390835:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc8d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d545 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390852:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d545 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.390860:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:3.0:1788744396.390862:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744396.390865:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfe00, rc 0) 00000100:00100000:3.0:1788744396.391189:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11346:x1875634138699136:12345-192.168.203.4@tcp:101:cat.0 Request processed in 3111us (7363us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788744396.391198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:1.0:1788744396.397750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744396.397831:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138699392 00000100:00100000:3.0:1788744396.397841:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138699392 00000100:00100000:3.0:1788744396.397908:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1788744396.397918:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11346:x1875634138699392:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:3.0:1788744396.398224:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:11346:x1875634138699392:12345-192.168.203.4@tcp:35:cat.0 Request processed in 307us (495us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788744396.398232:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788744396.419906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.419994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138699648 00000100:00100000:0.0:1788744396.420004:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138699648 00000100:00100000:0.0:1788744396.420058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:0.0:1788744396.420069:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:11347:x1875634138699648:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1788744396.420124:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788744396.420150:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc883 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d530 expref: 36 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420171:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dcc8e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d545 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420184:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcc8bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d53e expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420197:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d529 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420221:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.420226:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744396.420249:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420471:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420484:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420508:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420515:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420522:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420598:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420606:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.420612:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744396.421195:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788744396.421207:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378102803910ns, next at 379102801580ns, rc = 0 00010000:00010000:0.0:1788744396.421384:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421395:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421491:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421562:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421568:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421575:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421638:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744396.421660:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421666:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421673:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421679:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.421684:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421691:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421709:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:0.0:1788744396.421712:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788744396.421716:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421722:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc901 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421818:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421826:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421831:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421836:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.421838:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421844:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421851:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744396.421853:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.421856:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421861:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc8f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744396.421882:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c79db832 reply state 000000006cfa3289 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421894:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.421900:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:0.0:1788744396.421902:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744396.421904:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744396.422056:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:11347:x1875634138699648:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1985us (2156us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788744396.422065:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00010000:00010000:3.0:1788744396.423283:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744396.423297:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.423308:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744396.423327:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.423336:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.423351:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:3.0:1788744396.423353:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744396.423357:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.423363:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcc908 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.423379:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744396.423381:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744396.423383:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744396.458550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.458793:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138699904 00000100:00100000:0.0:1788744396.458805:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138699904 00000100:00100000:0.0:1788744396.458869:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:0.0:1788744396.458880:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:11353:x1875634138699904:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.458904:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.458924:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc90f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d54c expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459033:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459048:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459060:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459085:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459093:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459101:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744396.459702:0:10509:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788744396.459927:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459948:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459956:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459988:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.459996:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460003:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460009:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.460013:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460031:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460044:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744396.460046:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.460051:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460056:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcc916 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744396.460072:0:10509:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002208dc3a reply state 000000003ba2b8f6 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460082:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460089:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:0.0:1788744396.460091:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744396.460094:0:10509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788744396.460123:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcc90f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 37 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460138:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 36 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.460145:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:0.0:1788744396.460147:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744396.460150:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad000, rc 0) 00000100:00100000:0.0:1788744396.460298:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:11353:x1875634138699904:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1420us (1756us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788744396.460306:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:1.0:1788744396.468127:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.468218:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138700032 00000100:00100000:0.0:1788744396.468228:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138700032 00000100:00100000:0.0:1788744396.468437:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788744396.468449:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138700032:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.468469:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.468490:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d553 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744396.468523:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744396.468543:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788744396.468548:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744396.468558:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.468577:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.468591:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dada00, rc 0) 00000100:00100000:0.0:1788744396.468640:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138700032:12345-192.168.203.4@tcp:101:bash.0 Request processed in 193us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.468647:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788744396.472966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.473044:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138700160 00000100:00100000:0.0:1788744396.473053:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138700160 00000100:00100000:0.0:1788744396.473096:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1788744396.473118:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:11353:x1875634138700160:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744396.473137:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.473155:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d55a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.473199:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.473209:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744396.473214:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744396.473219:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.473249:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.473341:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.473358:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875634154506496:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744396.473642:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744396.476775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.476902:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875634154506496:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744396.476945:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.476988:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac800, rc 0) 00000100:00100000:0.0:1788744396.477049:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:11353:x1875634138700160:12345-192.168.203.4@tcp:101:bash.0 Request processed in 3931us (4089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.477057:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:2.0:1788744396.478905:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138700288 00000100:00100000:2.0:1788744396.478918:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138700288 00010000:00010000:2.0:1788744396.478972:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.479067:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1788744396.479080:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138700288:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744396.479095:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744396.479131:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.479147:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.479173:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcc932 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d553 expref: 9 pid: 8432 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.479192:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744396.479197:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744396.479206:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.479215:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.479266:0:9517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.479280:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9517:1875634154506624:192.168.203.4@tcp:105: 00000100:00100000:2.0:1788744396.479363:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744396.484392:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.484550:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9517:1875634154506624:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788744396.484577:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744396.484639:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138700288:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5561us (7872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.484670:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:3.0:1788744396.485689:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138700544 00000100:00100000:3.0:1788744396.485701:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138700544 00000100:00100000:2.0:1788744396.485926:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788744396.485946:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:11353:x1875634138700544:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1788744396.486217:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11353:x1875634138700544:12345-192.168.203.4@tcp:35:bash.0 Request processed in 280us (1836us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788744396.486225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788744396.617810:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744396.618133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138700672 00000100:00100000:1.0:1788744396.618144:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138700672 00000100:00100000:1.0:1788744396.618203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:1.0:1788744396.618215:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:11369:x1875634138700672:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744396.618240:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744396.618259:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d561 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.618323:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcc947 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.618338:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcc947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.618350:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcc947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744396.618448:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788744396.618452:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744396.618471:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcc947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.618516:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dcc940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d561 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.618535:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcc947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d561 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.618543:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:1.0:1788744396.618546:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744396.618550:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535200, rc 0) 00000100:00100000:1.0:1788744396.618615:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:11369:x1875634138700672:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 402us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744396.618622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:1.0:1788744396.623079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.623215:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138700928 00000100:00100000:0.0:1788744396.623225:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138700928 00000100:00100000:0.0:1788744396.623285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:0.0:1788744396.623296:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:11369:x1875634138700928:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744396.623318:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.623337:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcc94e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d568 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.623755:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcc955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.623772:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcc955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.623784:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcc955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744396.623797:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788744396.624014:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcc94e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d568 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.624037:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcc955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d568 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.624063:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:0.0:1788744396.624066:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744396.624070:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dade00, rc 0) 00000100:00100000:0.0:1788744396.624209:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+41:11369:x1875634138700928:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 914us (1140us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788744396.624217:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:2.0:1788744396.629162:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.629204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.629273:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138701184 00000100:00100000:0.0:1788744396.629283:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138701184 00000100:00100000:0.0:1788744396.629341:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:0.0:1788744396.629351:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+41:11369:x1875634138701184:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744396.629376:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.629396:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc963 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d56f expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.629545:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc96a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.629560:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc96a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.629572:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc96a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744396.629585:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788744396.629683:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc963 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d56f expref: 44 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.629720:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc96a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d56f expref: 43 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.629728:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:0.0:1788744396.629731:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744396.629957:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dace00, rc 0) 00000100:00100000:0.0:1788744396.630020:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:11369:x1875634138701184:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 670us (865us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788744396.630027:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:3.0:1788744396.630479:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138701312 00000100:00100000:3.0:1788744396.630498:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138701312 00000100:00100000:3.0:1788744396.630542:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788744396.630550:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:2394:x1875634138701312:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744396.630561:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744396.630577:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcc955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d568 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.630592:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:3.0:1788744396.630596:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744396.630640:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:2394:x1875634138701312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 90us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744396.630648:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788744396.640255:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.640330:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138701440 00000100:00100000:0.0:1788744396.640340:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138701440 00000100:00100000:0.0:1788744396.640394:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:0.0:1788744396.640440:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138701440:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1788744396.640484:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.640748:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.640757:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744396.640760:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744396.640765:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.640803:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.640832:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 8 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.640847:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875634154506752:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744396.640943:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744396.647292:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875634154506752:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744396.647323:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.647595:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744396.647725:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138701568 00000100:00100000:1.0:1788744396.647742:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138701568 00002000:00100000:1.0:1788744396.647798:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ac643354700 x1875634138701568/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:672/0 lens 504/0 e 0 to 0 dl 1788744407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744396.647809:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643354700 with x1875634138701568 ext(0->8) 00010000:00010000:1.0:1788744396.647818:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 9 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.647835:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 9 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744396.647844:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac643354700 00000100:00100000:1.0:1788744396.647880:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788744396.647907:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138701568:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:1.0:1788744396.649050:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:2395:x1875634138701568:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 1138us (1449us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788744396.649062:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00100000:1.0:1788744396.649072:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ac643354700 x1875634138701568/t4294967303(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:672/0 lens 504/448 e 0 to 0 dl 1788744407 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744396.649083:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643354700 with x1875634138701568 ext(0->8) 00010000:00010000:1.0:1788744396.649091:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 11 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.649107:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 11 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744396.649115:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac643354700 00000100:00100000:1.0:1788744396.652133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.652212:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138701696 00000100:00100000:2.0:1788744396.652223:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138701696 00010000:00010000:2.0:1788744396.652261:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 11 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.652303:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1788744396.652314:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:2397:x1875634138701696:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744396.652328:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788744396.652345:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788744396.652347:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788744397 00002000:00010000:2.0:1788744396.652349:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788744397 00002000:00010000:2.0:1788744396.652361:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788744397 00002000:00010000:2.0:1788744396.652363:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788744396.652371:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 11 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.652385:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 11 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.652436:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcc939 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d55a expref: 11 pid: 8431 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.652454:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744396.652458:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744396.652464:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.652475:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.652663:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744396.652727:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2397:x1875634138701696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 414us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.652743:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00010000:00010000:0.0:1788744396.652835:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652845:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652864:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652873:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652881:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652887:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744396.652891:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652912:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652924:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.652931:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcc978 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.652990:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2394:x1875634138701440:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 12588us (12746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744396.652999:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788744396.655843:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744396.655869:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154506880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744396.655949:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744396.656037:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154506880 00000100:00100000:2.0:1788744396.656048:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154506880 00000100:00100000:2.0:1788744396.656098:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788744396.656108:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154506880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744396.656168:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744396.656234:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154506880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.656241:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788744396.656323:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154506880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744396.657324:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.657994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138701952 00000100:00100000:0.0:1788744396.658004:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138701952 00000100:00100000:0.0:1788744396.658058:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1788744396.658068:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750211450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:11369:x1875634138701952:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:0.0:1788744396.658123:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc96a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d56f expref: 42 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744396.658296:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788744396.658330:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788744396.658949:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788744396.658986:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.659003:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 46 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.659018:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.659050:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 46 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.659063:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 46 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.659077:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875634154507008:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744396.659224:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744396.663161:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.663231:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138702080 00000100:00100000:2.0:1788744396.663242:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138702080 00010000:00010000:2.0:1788744396.663284:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 47 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.663327:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:2.0:1788744396.663337:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:2395:x1875634138702080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744396.663351:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744396.663357:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 47 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.663371:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 47 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.663392:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:2.0:1788744396.663398:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.663459:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.663467:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.663839:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744396.663890:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:2395:x1875634138702080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 554us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.663899:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00010000:00010000:0.0:1788744396.664817:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d54c expref: 46 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.664841:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875634154507008:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744396.664862:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.665062:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.665070:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744396.665197:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788744396.665314:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788744396.667589:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154507136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788744396.667682:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744396.667715:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744396.668041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154507136 00000100:00100000:2.0:1788744396.668051:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154507136 00000100:00100000:2.0:1788744396.668111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788744396.668121:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1875634154507136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744396.668385:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1875634154507136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 265us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.668394:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788744396.668888:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154507136:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788744396.669133:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788744396.669206:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154507264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788744396.669248:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744396.669314:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744396.669362:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154507264 00000100:00100000:2.0:1788744396.669369:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154507264 00000100:00100000:2.0:1788744396.673950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788744396.673974:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6518:x1875634154507264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744396.674182:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6518:x1875634154507264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 220us (4932us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788744396.674190:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788744396.674308:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154507264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788744396.674369:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788744396.674439:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.674464:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.674472:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.674478:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.674482:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.674503:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.674519:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:0.0:1788744396.674522:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788744396.674526:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.674533:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc97f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744396.674634:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788744396.674706:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788744396.674717:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378356314841ns, next at 379356312819ns, rc = 0 00000001:00080000:0.0:1788744396.674723:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788744396.674756:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:0.0:1788744396.674759:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744396.674766:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc96a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d56f expref: 50 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744396.674869:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750211450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:11369:x1875634138701952:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 16802us (17549us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788744396.674877:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000020:00080000:0.0:1788744396.674880:0:6518:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788744396.678711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744396.678805:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138702208 00000100:00100000:3.0:1788744396.678815:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138702208 00000100:00100000:3.0:1788744396.678876:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:3.0:1788744396.678887:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:11369:x1875634138702208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744396.678910:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744396.678942:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d576 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.678998:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc986 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d576 expref: 50 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.679012:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc986 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d576 expref: 50 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.679029:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744396.679032:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744396.679035:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf400, rc 0) 00000100:00100000:3.0:1788744396.679093:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+50:11369:x1875634138702208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 207us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744396.679100:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:2.0:1788744396.683008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.683173:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138702464 00000100:00100000:0.0:1788744396.683184:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138702464 00000100:00100000:0.0:1788744396.683243:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788744396.683253:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+50:11369:x1875634138702464:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788744396.683908:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+51:11369:x1875634138702464:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 653us (906us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788744396.683917:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788744396.761064:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.761220:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138702592 00000100:00100000:0.0:1788744396.761230:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138702592 00000100:00100000:0.0:1788744396.761289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:0.0:1788744396.761300:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+51:11379:x1875634138702592:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1788744396.761379:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761397:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761703:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761717:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761751:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761759:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761833:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761842:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761849:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744396.761896:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761910:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761917:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761923:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761930:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.761945:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761954:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761973:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744396.761977:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.761982:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.761989:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc98d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762003:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762010:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762016:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762021:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.762024:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762030:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762038:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:0.0:1788744396.762040:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.762044:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762049:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762070:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762076:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762082:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762087:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.762090:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762272:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762282:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744396.762284:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.762287:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.762293:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc99b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.762783:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+51:11379:x1875634138702592:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1481us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.762793:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:2.0:1788744396.804692:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.804831:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138702848 00000100:00100000:0.0:1788744396.804842:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138702848 00000100:00100000:0.0:1788744396.804905:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:0.0:1788744396.804915:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+51:11382:x1875634138702848:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744396.804945:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744396.804966:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc9a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d57d expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805057:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805071:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805083:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805092:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805100:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805107:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805213:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805223:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805230:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744396.805240:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788744396.805314:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805332:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805339:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805345:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.805349:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805357:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805368:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744396.805371:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.805376:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805382:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcc9a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805396:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805532:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805538:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805543:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744396.805552:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805559:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805568:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:0.0:1788744396.805571:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744396.805574:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805580:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcc9b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805618:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dcc9a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 54 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805634:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 53 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744396.805640:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744396.805642:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744396.805645:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad600, rc 0) 00000100:00100000:0.0:1788744396.805700:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:11382:x1875634138702848:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 786us (1017us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788744396.805708:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:3.0:1788744396.809295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.809389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138702976 00000100:00100000:2.0:1788744396.809398:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138702976 00000100:00100000:2.0:1788744396.809841:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1788744396.809866:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:11382:x1875634138702976:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1788744396.809951:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.809969:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.809980:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810018:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810025:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810032:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810039:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.810043:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810051:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810063:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.810066:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744396.810070:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.810076:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.810374:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:11382:x1875634138702976:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 508us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.810382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:3.0:1788744396.813794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744396.813905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138703232 00000100:00100000:0.0:1788744396.813915:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138703232 00000100:00100000:0.0:1788744396.814009:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:0.0:1788744396.814020:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:11382:x1875634138703232:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788744396.814258:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11382:x1875634138703232:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 239us (532us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788744396.814266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1788744396.890372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.890627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138703488 00000100:00100000:2.0:1788744396.890639:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138703488 00000100:00100000:2.0:1788744396.890704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:2.0:1788744396.890716:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11392:x1875634138703488:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744396.890750:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744396.890754:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744396.890782:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcc947 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d561 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.890803:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744396.890809:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744396.890823:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.890947:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.890962:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 54 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.890971:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.891004:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 54 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.891033:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 54 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.891048:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507392:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744396.891158:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744396.899063:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.899222:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507392:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744396.899252:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744396.899364:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138703616 00000100:00100000:1.0:1788744396.899371:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138703616 00010000:00010000:1.0:1788744396.899435:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 55 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744396.899473:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788744396.899493:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:2394:x1875634138703616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744396.899515:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744396.899522:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 55 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.899536:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 55 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.899560:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcc9b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d57d expref: 55 pid: 10509 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.899576:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744396.899588:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.899597:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.899605:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.899632:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744396.899692:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:2394:x1875634138703616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 209us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744396.899700:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00010000:00010000:2.0:1788744396.899716:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.899726:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744396.899746:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788744396.899882:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.899899:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.899907:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.899910:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744396.899912:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59400, rc 0) 00000100:00100000:2.0:1788744396.900068:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11392:x1875634138703488:12345-192.168.203.4@tcp:101:bash.0 Request processed in 9354us (9705us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788744396.900086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:3.0:1788744396.903165:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.903259:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138703744 00000100:00100000:2.0:1788744396.903269:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138703744 00000100:00100000:2.0:1788744396.903327:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1788744396.903337:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:11392:x1875634138703744:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744396.903358:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744396.903376:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc9e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d58b expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.903452:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.903466:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.903476:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.903603:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc9e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 56 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.903621:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 55 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.903630:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.903633:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744396.903637:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58200, rc 0) 00000100:00100000:2.0:1788744396.903697:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:11392:x1875634138703744:12345-192.168.203.4@tcp:101:bash.0 Request processed in 360us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.903711:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:3.0:1788744396.907519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.907955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704000 00000100:00100000:2.0:1788744396.907967:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704000 00000100:00100000:2.0:1788744396.908027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1788744396.908036:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:11392:x1875634138704000:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1788744396.908256:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.908274:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.908285:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744396.908329:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788744396.908352:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000045141007 reply state 000000001f758da1 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.908364:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.908371:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.908374:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744396.908377:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744396.908759:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11392:x1875634138704000:12345-192.168.203.4@tcp:36:bash.0 Request processed in 723us (1247us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788744396.908767:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000020:00080000:2.0:1788744396.908773:0:6515:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788744396.911694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.911922:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704128 00000100:00100000:2.0:1788744396.911943:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704128 00000100:00100000:2.0:1788744396.912013:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788744396.912024:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11392:x1875634138704128:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744396.912049:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744396.912070:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc9f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.912168:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.912183:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.912192:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.912224:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.912237:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 59 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.912252:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507520:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744396.912338:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744396.915811:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507520:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744396.915841:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744396.919544:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.920076:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704256 00000100:00100000:2.0:1788744396.920102:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704256 00010000:00010000:2.0:1788744396.920142:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.920189:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1788744396.920200:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:2394:x1875634138704256:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744396.920215:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744396.920222:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.920235:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.920258:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcc9d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d584 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.920276:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.920281:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.920291:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.920298:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.920330:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744396.920380:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:2394:x1875634138704256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.920443:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00010000:00010000:3.0:1788744396.920755:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.920764:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744396.920824:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788744396.920830:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744396.920851:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.920883:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcc9f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.920898:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744396.920906:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744396.920909:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744396.920912:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58c00, rc 0) 00000100:00100000:3.0:1788744396.920957:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11392:x1875634138704128:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8935us (9271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744396.920964:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:3.0:1788744396.924509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744396.924782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704512 00000100:00100000:1.0:1788744396.924792:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704512 00000100:00100000:1.0:1788744396.924842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788744396.924853:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:11392:x1875634138704512:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788744396.925085:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11392:x1875634138704512:12345-192.168.203.4@tcp:35:bash.0 Request processed in 233us (596us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788744396.925093:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000040:00080000:3.0:1788744396.975124:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788744396.980985:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744396.981084:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704640 00000100:00100000:1.0:1788744396.981094:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704640 00000100:00100000:1.0:1788744396.981152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:1.0:1788744396.981163:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:11398:x1875634138704640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744396.981185:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744396.981205:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d599 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.981268:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcca0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.981295:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcca0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.981307:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcca0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744396.981350:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788744396.981354:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744396.981371:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcca0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.981395:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d599 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.981457:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcca0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d599 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.981466:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:1.0:1788744396.981469:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744396.981473:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535200, rc 0) 00000100:00100000:1.0:1788744396.981771:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11398:x1875634138704640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 609us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744396.981779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1788744396.985665:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.985784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704768 00000100:00100000:2.0:1788744396.985795:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704768 00000100:00100000:2.0:1788744396.985851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1788744396.985862:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11398:x1875634138704768:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744396.985881:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744396.985900:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcca12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.985970:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.985985:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.985996:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986008:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986016:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986024:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986090:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986110:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986118:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744396.986159:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788744396.986163:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744396.986180:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986192:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986201:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986207:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986214:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986220:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.986224:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986231:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986241:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744396.986245:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.986257:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986264:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986277:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986283:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986289:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986294:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744396.986297:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986304:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986312:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:2.0:1788744396.986314:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744396.986317:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986323:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986345:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcca12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986370:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.986377:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.986379:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744396.986382:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59800, rc 0) 00000100:00100000:2.0:1788744396.986487:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11398:x1875634138704768:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 626us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744396.986495:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:3.0:1788744396.992280:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744396.992389:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744396.992707:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138705152 00000100:00100000:2.0:1788744396.992716:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138705152 00000100:00100000:2.0:1788744396.992783:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1788744396.992794:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11398:x1875634138705152:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744396.992823:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744396.992842:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcca2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.992960:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.992976:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.992984:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.993008:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.993043:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.993056:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 62 pid: 6515 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.993069:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507648:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744396.993211:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.993222:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.993231:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507776:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744396.993257:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744396.993532:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138704896 00000100:00100000:1.0:1788744396.993538:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138704896 00010000:00010000:1.0:1788744396.993562:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 63 pid: 6515 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744396.993592:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1788744396.993608:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:2396:x1875634138704896:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744396.993618:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744396.993624:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 63 pid: 6515 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.993635:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 63 pid: 6515 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.993652:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744396.993656:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.993663:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744396.993669:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744396.993695:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:2396:x1875634138704896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 87us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744396.993702:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00010000:00010000:2.0:1788744396.996703:0:6517:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000082a8adff x1875634154507648) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 62 pid: 6515 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.996728:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcca27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a0 expref: 62 pid: 6515 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744396.996754:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507648:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744396.996786:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154507776:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744396.996810:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744396.996815:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.996824:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744396.996833:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.007140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.008060:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138705280 00000100:00100000:1.0:1788744397.008072:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138705280 00010000:00010000:1.0:1788744397.008113:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744397.008156:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:1.0:1788744397.008167:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:2395:x1875634138705280:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744397.008182:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744397.008190:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.008216:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.008236:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcc9fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d592 expref: 62 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.008252:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744397.008258:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.008268:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.008275:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.008308:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744397.008367:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:2395:x1875634138705280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 202us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.008374:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00010000:00010000:3.0:1788744397.009380:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.009394:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744397.009453:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788744397.009592:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcca2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.009611:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.009618:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744397.009621:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744397.009625:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59600, rc 0) 00000100:00100000:3.0:1788744397.009670:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11398:x1875634138705152:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 16877us (17281us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788744397.009676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1788744397.019309:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.019439:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138705536 00000100:00100000:1.0:1788744397.019450:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138705536 00000100:00100000:1.0:1788744397.019722:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788744397.019743:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11398:x1875634138705536:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:1.0:1788744397.019760:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744397.019784:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcc986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d576 expref: 61 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.019832:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744397.019838:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744397.019907:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11398:x1875634138705536:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 175us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.019915:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788744397.022584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.022858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138705664 00000100:00100000:1.0:1788744397.022869:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138705664 00000100:00100000:1.0:1788744397.022976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:1.0:1788744397.022988:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11398:x1875634138705664:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:1.0:1788744397.023089:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.023106:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.023117:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744397.023206:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788744397.023288:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11398:x1875634138705664:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 302us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.023295:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:0.0:1788744397.025723:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744397.025817:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138705792 00000100:00100000:3.0:1788744397.025827:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138705792 00000100:00100000:3.0:1788744397.025885:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:3.0:1788744397.025895:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:11398:x1875634138705792:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744397.025917:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744397.025944:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5ae expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.026021:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.026034:0:7792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 61 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.026054:0:7792:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.026068:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 61 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.026082:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744397.026085:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744397.026089:0:7792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 61 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.026096:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be000, rc 0) 00000100:00100000:3.0:1788744397.026157:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11398:x1875634138705792:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 262us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744397.026164:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00010000:00010000:1.0:1788744397.167022:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744397.231187:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744397.231197:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744397.231228:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788744397.231319:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744397.231586:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac743949180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154507904:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744397.231768:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742ba13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744397.240748:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.241295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138705920 00000100:00100000:2.0:1788744397.241305:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138705920 00000100:00100000:2.0:1788744397.241367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:2.0:1788744397.241377:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138705920:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744397.241431:0:6517:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744397.241644:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138705920:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 266us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.241652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1788744397.247226:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac743949180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154507904:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744397.247778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744397.247976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138706048 00000100:00100000:3.0:1788744397.247984:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138706048 00000100:00100000:3.0:1788744397.248039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:3.0:1788744397.248050:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11399:x1875634138706048:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788744397.248117:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248133:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248145:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248161:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248168:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248174:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248195:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248203:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248210:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744397.248336:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788744397.248341:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744397.248355:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248367:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248374:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248381:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248388:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.248392:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248595:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248611:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:3.0:1788744397.248614:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.248619:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248625:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcca51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248639:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248657:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248663:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248668:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.248671:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248678:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248686:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9ac74505fd00) 00010000:00010000:3.0:1788744397.248688:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.248691:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248698:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcca58 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248711:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248717:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248722:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248726:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfa00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.248865:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248872:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248880:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744397.248883:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.248886:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.248893:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcca5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744397.249208:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11399:x1875634138706048:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 1157us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744397.249218:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1788744397.252962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.253051:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138706304 00000100:00100000:0.0:1788744397.253061:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138706304 00000100:00100000:0.0:1788744397.253123:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:0.0:1788744397.253133:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:11399:x1875634138706304:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744397.253152:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744397.253171:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcca66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5b5 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253596:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253613:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253624:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744397.253636:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788744397.253710:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253719:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253804:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253811:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dade00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744397.253815:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253823:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253835:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744397.253838:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744397.253843:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253849:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcca6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253891:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcca66 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5b5 expref: 63 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253902:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:0.0:1788744397.253905:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744397.253909:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dcca66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5b5 expref: 63 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.253919:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac800, rc 0) 00000100:00100000:0.0:1788744397.253988:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138706304:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 856us (1033us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788744397.254005:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:0.0:1788744397.259770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.259953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138706432 00000100:00100000:2.0:1788744397.259964:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138706432 00000100:00100000:2.0:1788744397.260038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1788744397.260050:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138706432:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744397.260092:0:6517:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744397.260246:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138706432:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 198us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.260254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1788744397.263541:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.263642:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138706688 00000100:00100000:0.0:1788744397.263653:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138706688 00000100:00100000:0.0:1788744397.263707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:0.0:1788744397.263717:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138706688:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744397.263745:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744397.263748:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788744397.263774:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcca0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d599 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.263796:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:0.0:1788744397.263801:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744397.263813:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcca7b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5bc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744397.264199:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788744397.264340:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcca82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.264354:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcca82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.264363:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcca82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.264446:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dcca7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5bc expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.264480:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcca82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5bc expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.264488:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:0.0:1788744397.264490:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744397.264493:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac000, rc 0) 00000100:00100000:0.0:1788744397.264550:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:11399:x1875634138706688:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 834us (1018us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788744397.264557:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:0.0:1788744397.273231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.273708:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138706944 00000100:00100000:2.0:1788744397.273718:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138706944 00000100:00100000:2.0:1788744397.273789:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1788744397.273798:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:11399:x1875634138706944:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.273849:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744397.273874:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcca82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5bc expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.273893:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac642257f00) 00010000:00010000:2.0:1788744397.273904:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744397.273924:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.273955:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.273965:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.273979:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.273985:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.273992:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274049:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274056:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274062:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274068:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744397.274072:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274079:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274087:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:2.0:1788744397.274090:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744397.274094:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274100:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcca90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274110:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274116:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274121:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274132:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744397.274135:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274142:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274150:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3cab4644 (ffff9ac76020c400) 00010000:00010000:2.0:1788744397.274153:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744397.274156:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.274161:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3cab4644 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.274256:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138706944:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 458us (1034us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744397.274263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:3.0:1788744397.279684:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.280014:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138707072 00000100:00100000:2.0:1788744397.280025:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138707072 00000100:00100000:2.0:1788744397.280079:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:2.0:1788744397.280090:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:11399:x1875634138707072:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.280112:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744397.280137:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5c3 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.280176:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.280207:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.280219:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.280325:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcca9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 64 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.280343:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 63 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.280351:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744397.280354:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744397.280358:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59200, rc 0) 00000100:00100000:2.0:1788744397.280467:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:11399:x1875634138707072:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 378us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.280475:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1788744397.284579:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.284683:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138707328 00000100:00100000:2.0:1788744397.284692:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138707328 00000100:00100000:2.0:1788744397.284751:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:2.0:1788744397.284760:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:11399:x1875634138707328:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.284832:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.284849:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.284878:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744397.285045:0:10509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788744397.285094:0:10509:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b9a8c369 reply state 000000009a731b17 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.285107:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.285115:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744397.285118:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788744397.285121:0:10509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744397.285213:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:11399:x1875634138707328:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 454us (640us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788744397.285221:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:3.0:1788744397.291097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.291185:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138707456 00000100:00100000:2.0:1788744397.291195:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138707456 00000100:00100000:2.0:1788744397.291257:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:2.0:1788744397.291268:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:11399:x1875634138707456:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.291291:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744397.291310:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.291367:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.291381:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.291453:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744397.291456:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744397.291459:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744397.291514:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:11399:x1875634138707456:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 248us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.291521:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:3.0:1788744397.294055:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.294140:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138707584 00000100:00100000:1.0:1788744397.294149:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138707584 00000100:00100000:1.0:1788744397.294203:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788744397.294211:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138707584:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788744397.294470:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2394:x1875634138707584:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 258us (421us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788744397.294477:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:0.0:1788744397.299282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.299744:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138707840 00000100:00100000:1.0:1788744397.299755:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138707840 00000100:00100000:1.0:1788744397.299820:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788744397.299831:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:11399:x1875634138707840:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744397.300065:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:11399:x1875634138707840:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 235us (791us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788744397.300074:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1788744397.304042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.304146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708096 00000100:00100000:0.0:1788744397.304156:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708096 00000100:00100000:0.0:1788744397.304215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:0.0:1788744397.304226:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:11399:x1875634138708096:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744397.304351:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:11399:x1875634138708096:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 126us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744397.304358:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:2.0:1788744397.307463:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.307741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708224 00000100:00100000:0.0:1788744397.307751:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708224 00000100:00100000:0.0:1788744397.307812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:0.0:1788744397.307823:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:11399:x1875634138708224:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744397.307844:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744397.307877:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dccaba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.307954:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.307968:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.307980:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744397.308021:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744397.308041:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.308067:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dccaba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d1 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.308085:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d1 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.308092:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:0.0:1788744397.308095:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788744397.308099:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac800, rc 0) 00000100:00100000:0.0:1788744397.308160:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:11399:x1875634138708224:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 338us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744397.308168:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:3.0:1788744397.310980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.311082:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708352 00000100:00100000:2.0:1788744397.311092:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708352 00000100:00100000:2.0:1788744397.311149:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:2.0:1788744397.311160:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138708352:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.311178:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744397.311201:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5d8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744397.311226:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e12ce, blocks: 0x0 00010000:00010000:2.0:1788744397.311257:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1788744397.311262:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744397.311271:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.311287:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.311301:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58a00, rc 0) 00000100:00100000:2.0:1788744397.311378:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2395:x1875634138708352:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 219us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.311386:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788744397.324689:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.324852:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708608 00000100:00100000:2.0:1788744397.324862:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708608 00000100:00100000:2.0:1788744397.324925:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:2.0:1788744397.324944:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:11399:x1875634138708608:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788744397.325053:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:11399:x1875634138708608:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 110us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.325060:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:3.0:1788744397.328283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.328435:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708736 00000100:00100000:1.0:1788744397.328444:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708736 00000100:00100000:1.0:1788744397.328506:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:1.0:1788744397.328515:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:11399:x1875634138708736:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744397.328532:0:8966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744397.328548:0:8966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5df expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.328576:0:8966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.328585:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788744397.328589:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744397.328594:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 11 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.328653:0:8966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.328668:0:8966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744397.328681:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8966:1875634154508032:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744397.328773:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744397.332313:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8966:1875634154508032:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744397.332349:0:8966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 11 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.332369:0:8966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741534000, rc 0) 00000100:00100000:1.0:1788744397.332458:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:11399:x1875634138708736:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3943us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.332467:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1788744397.334301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.334456:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708864 00000100:00100000:2.0:1788744397.334466:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708864 00010000:00010000:2.0:1788744397.334531:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.334575:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1788744397.334585:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:2395:x1875634138708864:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744397.334600:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744397.334620:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.334634:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.334661:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dccac8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d8 expref: 11 pid: 8430 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.334697:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744397.334702:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744397.334711:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 10 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.334721:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 10 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.334770:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 10 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.334784:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875634154508160:192.168.203.4@tcp:105: 00000100:00100000:2.0:1788744397.334859:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744397.341449:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875634154508160:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788744397.341477:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744397.341536:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2395:x1875634138708864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 6953us (7242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.341547:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1788744397.347013:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.347280:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138708992 00000100:00100000:2.0:1788744397.347292:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138708992 00002000:00100000:2.0:1788744397.347345:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ac753049500 x1875634138708992/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:673/0 lens 504/0 e 0 to 0 dl 1788744408 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744397.347356:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac753049500 with x1875634138708992 ext(0->12) 00002000:00010000:2.0:1788744397.347362:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac753049500 00000100:00100000:2.0:1788744397.347451:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788744397.347461:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2395:x1875634138708992:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788744397.349398:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:2395:x1875634138708992:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1927us (2384us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788744397.349446:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:2.0:1788744397.349457:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ac753049500 x1875634138708992/t4294967309(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:673/0 lens 504/448 e 0 to 0 dl 1788744408 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744397.349468:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac753049500 with x1875634138708992 ext(0->12) 00002000:00010000:2.0:1788744397.349473:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac753049500 00000100:00100000:3.0:1788744397.359115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.359520:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138709120 00000100:00100000:2.0:1788744397.359531:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138709120 00000100:00100000:2.0:1788744397.359593:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:2.0:1788744397.359603:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:11399:x1875634138709120:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788744397.362973:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788744397.363012:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788744397.363037:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac774ab9240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788744397.363042:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac77cb5b000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac774ab9000 00000020:00080000:1.0:1788744397.363046:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac77cb5b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac77c91e800 00000004:00080000:1.0:1788744397.363078:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788744397.363112:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac77aa78cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788744397.363127:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac6426f7200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac761d29d80 00000020:00080000:1.0:1788744397.363130:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac6426f7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac642656c00 00000020:00080000:1.0:1788744397.363144:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788744397.363211:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788744397.363302:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788744397.363497:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363520:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363527:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363534:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.363538:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363545:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363563:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ac74505f400) 00010000:00010000:3.0:1788744397.363566:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.363571:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363577:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcc7d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363604:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363610:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363616:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363620:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.363629:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363636:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363644:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ac642257300) 00010000:00010000:3.0:1788744397.363646:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.363650:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363656:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dcc87c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363671:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363677:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363683:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363687:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.363689:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363694:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363701:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:3.0:1788744397.363703:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.363711:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363717:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcc8fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363727:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363746:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363751:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363756:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.363760:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363766:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363774:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257b00) 00010000:00010000:3.0:1788744397.363776:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.363779:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363784:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcc91d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363798:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363815:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363821:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363825:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.363828:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363834:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363842:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744397.363845:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.363848:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363854:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcc9ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363867:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363874:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363880:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363885:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.363894:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363901:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363909:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744397.363911:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744397.363914:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.363920:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccaac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.364519:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11399:x1875634138709120:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 4912us (5409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.364530:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:3.0:1788744397.365506:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154508416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788744397.365556:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744397.365585:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744397.365591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154508288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788744397.365609:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744397.365741:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154508416 00000100:00100000:0.0:1788744397.365749:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154508416 00000100:00100000:0.0:1788744397.365796:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154508288 00000100:00100000:0.0:1788744397.365799:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154508288 00000100:00100000:0.0:1788744397.365817:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744397.365825:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75304ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154508416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788744397.365849:0:8430:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788744397.365869:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.365888:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.365897:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788744397.365902:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744397.365906:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.365944:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.365959:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 11 pid: 8431 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.365970:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875634154508544:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744397.366021:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744397.366036:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744397.366053:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1875634154508288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788744397.366065:0:8966:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788744397.366084:0:8966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e12cd, atime: 0x6a9e12cd, ctime: 0x6a9e12cd, blocks: 0x8 00010000:00010000:0.0:1788744397.366089:0:8966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366099:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1788744397.366102:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744397.366107:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366122:0:8966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366131:0:8966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366140:0:8966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366157:0:8966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744397.366645:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1875634154508288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 591us (1033us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788744397.366652:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1788744397.366673:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744397.366679:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366700:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744397.366704:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.366713:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788744397.366803:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744397.366808:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788744397.367684:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac643e95f80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788744397.367695:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154508288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788744397.368604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1788744397.368707:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.368720:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dccadd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.368751:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744397.368753:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744397.368755:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744397.368871:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138709248 00000100:00100000:1.0:1788744397.368879:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138709248 00000100:00100000:1.0:1788744397.368925:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788744397.368943:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:2394:x1875634138709248:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788744397.373711:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788744397.373744:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1788744397.373964:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138709248:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 5016us (5358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.373976:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:2.0:1788744397.374643:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875634154508544:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744397.374668:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744397.374980:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.375055:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138709376 00000100:00100000:2.0:1788744397.375063:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138709376 00010000:00010000:2.0:1788744397.375094:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 7 pid: 8431 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.375181:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1788744397.375192:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138709376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744397.375208:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744397.375213:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 7 pid: 8431 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.375226:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 7 pid: 8431 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.375263:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcc88a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d537 expref: 7 pid: 8431 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.375278:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744397.375283:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744397.375288:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.375298:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.375330:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744397.375375:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138709376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 185us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.375381:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00010000:00010000:0.0:1788744397.375745:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.375757:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.375766:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.375786:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.375801:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744397.375973:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75304ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154508416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10148us (10415us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788744397.375981:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744397.376017:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788744397.376023:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788744397.376047:0:3644:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ac643e95c00 x1875634154508416/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788744413 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788744397.376057:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac643e95c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788744397.376068:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154508416:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788744397.376270:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744397.376277:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.376285:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744397.376289:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.376298:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.376312:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.376330:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.376349:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744397.376350:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744397.376352:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744397.379903:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.380050:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138709632 00000100:00100000:2.0:1788744397.380061:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138709632 00000100:00100000:2.0:1788744397.380171:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:2.0:1788744397.380182:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11399:x1875634138709632:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.380236:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744397.380265:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5d1 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.380285:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744397.380291:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744397.380322:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.380336:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.380345:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744397.380501:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006e2e28d2 reply state 0000000067b5fcd4 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.380515:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.380521:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744397.380523:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744397.380526:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744397.380876:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:11399:x1875634138709632:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 694us (981us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788744397.380902:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:1.0:1788744397.385445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.385609:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138709760 00000100:00100000:0.0:1788744397.385620:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138709760 00000100:00100000:0.0:1788744397.385689:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788744397.385699:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138709760:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788744397.385844:0:8966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788744397.385848:0:8966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788744397 00002000:00010000:0.0:1788744397.385850:0:8966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788744397 00002000:00010000:0.0:1788744397.385852:0:8966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788744398 -> 1788744397 00002000:00010000:0.0:1788744397.385855:0:8966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788744397.385921:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138709760:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 222us (518us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788744397.385956:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788744397.390919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744397.391445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710016 00000100:00100000:3.0:1788744397.391457:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710016 00000100:00100000:3.0:1788744397.391517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1788744397.391528:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:11399:x1875634138710016:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788744397.391594:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.391625:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 17 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.391635:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.391670:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 17 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.391684:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 17 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744397.391698:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154508672:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744397.391794:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742ba13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744397.394574:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.394731:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710144 00000100:00100000:1.0:1788744397.394739:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710144 00010000:00010000:1.0:1788744397.394775:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 18 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744397.394809:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1788744397.394818:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2394:x1875634138710144:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744397.394832:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744397.394838:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 18 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.394849:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 18 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.394870:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:1.0:1788744397.394877:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.394886:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.394907:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.394926:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744397.394993:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2394:x1875634138710144:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.395000:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00010000:00010000:0.0:1788744397.395468:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccaa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5c3 expref: 17 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.395485:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154508672:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744397.395510:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395519:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395525:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395562:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395569:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395576:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395582:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744397.395587:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395594:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395611:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:0.0:1788744397.395614:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788744397.395618:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.395625:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccaeb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.395680:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11399:x1875634138710016:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 4154us (4768us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788744397.395689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1788744397.399821:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.399918:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710272 00000100:00100000:1.0:1788744397.399926:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710272 00000100:00100000:1.0:1788744397.400000:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1788744397.400009:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138710272:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788744397.400056:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.400079:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 7 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.400097:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744397.400103:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744397.400108:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.400145:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 7 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.400162:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 7 pid: 8966 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744397.400192:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875634154508800:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744397.400371:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744397.404228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.404390:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875634154508800:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744397.404453:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.405188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710400 00000100:00100000:2.0:1788744397.405196:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710400 00010000:00010000:2.0:1788744397.405233:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 8 pid: 8966 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.405282:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1788744397.405291:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138710400:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744397.405307:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744397.405326:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 8 pid: 8966 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.405338:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 8 pid: 8966 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.405359:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3654823/0xb6207a6e76dccacf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5df expref: 8 pid: 8966 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.405374:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744397.405378:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744397.405383:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.405393:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.405676:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744397.405735:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138710400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 444us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.405743:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00010000:00010000:0.0:1788744397.405942:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.405952:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.405971:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.405979:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.406000:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.406009:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744397.406013:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.406023:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.406036:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.406044:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011859208/0xb6207a6e76dccaf2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.406112:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138710272:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 6103us (6299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744397.406120:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1788744397.430520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.430622:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710656 00000100:00100000:2.0:1788744397.430632:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710656 00000100:00100000:2.0:1788744397.430694:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:2.0:1788744397.430704:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:11399:x1875634138710656:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788744397.430780:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.430798:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 16 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.430808:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.430840:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 16 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.430853:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 16 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.430867:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154508928:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744397.430961:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744397.438169:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154508928:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744397.438200:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744397.440535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.440737:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710784 00000100:00100000:2.0:1788744397.440759:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710784 00010000:00010000:2.0:1788744397.440799:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 17 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.440840:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788744397.440850:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:2394:x1875634138710784:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744397.440863:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744397.440870:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 17 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.440883:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 17 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.440906:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcc9e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d58b expref: 17 pid: 7792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.440923:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744397.440938:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 16 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.440948:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.440956:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.440964:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.441008:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744397.441069:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:2394:x1875634138710784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 220us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.441077:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00010000:00010000:0.0:1788744397.441376:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.441395:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.441596:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.441609:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.441617:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.441646:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.441659:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 16 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.441673:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154509056:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744397.441746:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744397.449728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744397.449861:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138710912 00000100:00100000:3.0:1788744397.449871:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138710912 00010000:00010000:3.0:1788744397.449913:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 17 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744397.449968:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1788744397.449979:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:2395:x1875634138710912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744397.449995:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744397.450002:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 17 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.450034:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 17 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.450059:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744397.450065:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.450076:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.450085:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.450187:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744397.450296:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+17:2395:x1875634138710912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 317us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744397.450304:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00010000:00010000:0.0:1788744397.450864:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccab3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ca expref: 16 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.450884:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154509056:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744397.450905:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.450913:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.450938:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744397.451039:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788744397.451154:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788744397.451186:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788744397.451266:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154509184:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788744397.451319:0:10509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744397.451358:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744397.452543:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154509184 00000100:00100000:3.0:1788744397.452554:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154509184 00000100:00100000:3.0:1788744397.452609:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788744397.452620:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10509:x1875634154509184:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788744397.452746:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10509:x1875634154509184:12345-0@lo:1000:mdt00_004.0 Request processed in 127us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744397.452753:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788744397.453677:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154509184:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788744397.453846:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788744397.453915:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154509312:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788744397.453970:0:10509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744397.453989:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744397.454446:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154509312 00000100:00100000:1.0:1788744397.454454:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154509312 00000100:00100000:1.0:1788744397.454501:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788744397.454508:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10509:x1875634154509312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788744397.454622:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10509:x1875634154509312:12345-0@lo:1000:mdt00_004.0 Request processed in 113us (650us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788744397.454633:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788744397.454724:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154509312:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788744397.454869:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454880:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454887:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454894:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744397.454898:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454923:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454953:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:0.0:1788744397.454955:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744397.454960:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454966:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454990:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.454997:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455002:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455007:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744397.455010:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455016:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455024:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744397.455026:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744397.455033:0:10509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 19 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455176:0:10509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 19 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455185:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 19 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.455214:0:10509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 19 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.455225:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154509440:192.168.203.4@tcp:105: 00000100:00100000:0.0:1788744397.455339:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744397.465041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.465214:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138711040 00000100:00100000:1.0:1788744397.465224:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138711040 00000100:00100000:1.0:1788744397.465290:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788744397.465302:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11398:x1875634138711040:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:1.0:1788744397.465475:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:11398:x1875634138711040:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 174us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.465484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1788744397.466069:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154509440:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788744397.466099:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466111:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcca43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466145:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466159:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466171:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466181:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466202:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466209:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466215:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744397.466219:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466227:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466240:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744397.466243:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744397.466247:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466253:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466265:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466271:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466278:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466284:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744397.466293:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466300:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466309:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744397.466312:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744397.466314:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.466321:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccaf9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744397.466721:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744397.466727:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744397.467266:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788744397.467276:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744397.467633:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:11399:x1875634138710656:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 36925us (37117us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788744397.467645:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000020:00080000:0.0:1788744397.467651:0:10509:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788744397.473120:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.473373:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138711296 00000100:00100000:2.0:1788744397.473382:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138711296 00000100:00100000:2.0:1788744397.473473:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1788744397.473485:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:11398:x1875634138711296:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:2.0:1788744397.473662:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788744397.473925:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:11398:x1875634138711296:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 440us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744397.473943:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:3.0:1788744397.475382:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.477661:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138711552 00000100:00100000:1.0:1788744397.477675:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138711552 00000100:00100000:2.0:1788744397.477882:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788744397.477896:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:11399:x1875634138711552:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788744397.478184:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788744397.478218:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788744397.478250:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.478278:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.478290:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.478298:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.478318:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.478324:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744397.478351:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744397.478474:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:11399:x1875634138711552:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 580us (3100us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788744397.478482:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000020:00080000:2.0:1788744397.478497:0:6519:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744397.479095:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744397.479103:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.479112:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744397.479116:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.479123:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.479136:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744397.479140:0:9528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744397.479145:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.479151:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccb0e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.479165:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744397.479167:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744397.479168:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744397.511327:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744397.511450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138711680 00000100:00100000:0.0:1788744397.511462:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138711680 00000100:00100000:0.0:1788744397.511527:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:0.0:1788744397.511538:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:11401:x1875634138711680:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744397.511566:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744397.511586:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccb15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511662:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511676:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511701:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511716:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511724:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511731:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511816:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511827:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511835:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511869:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744397.511881:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 22 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744397.511894:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154509568:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744397.512012:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744397.515156:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744397.515469:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138711936 00000100:00100000:2.0:1788744397.515480:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138711936 00000100:00100000:2.0:1788744397.515543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788744397.515553:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:9929:x1875634138711936:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788744397.515780:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:9929:x1875634138711936:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 227us (632us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788744397.515788:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:3.0:1788744397.517579:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154509568:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744397.517609:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744397.523647:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744397.523750:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138712064 00000100:00100000:1.0:1788744397.523761:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138712064 00010000:00010000:1.0:1788744397.523801:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 24 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744397.523873:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1788744397.523884:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:2395:x1875634138712064:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744397.523904:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744397.523912:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 24 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.523925:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 24 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.523962:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcca35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5a7 expref: 24 pid: 6517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.523980:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744397.523985:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.523995:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.524004:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744397.524039:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744397.524101:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:2395:x1875634138712064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 219us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.524109:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00010000:00010000:3.0:1788744397.524308:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524317:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744397.524368:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788744397.524373:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744397.524393:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524440:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524460:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524467:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524474:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524480:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.524484:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524492:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524501:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:3.0:1788744397.524512:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.524518:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524525:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dccb1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524538:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524603:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524610:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524616:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744397.524618:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524625:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524633:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ac642257800) 00010000:00010000:3.0:1788744397.524636:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744397.524639:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524644:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccb23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524688:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccb15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5e6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524715:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5e6 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744397.524724:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744397.524726:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744397.524729:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad000, rc 0) 00000100:00100000:3.0:1788744397.524778:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11401:x1875634138711680:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 13242us (13462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744397.524786:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:3.0:1788744397.678589:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744397.678611:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154509696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744397.678678:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744397.678862:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154509696 00000100:00100000:1.0:1788744397.678882:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154509696 00000100:00100000:1.0:1788744397.678952:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788744397.678963:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154509696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744397.678997:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788744397.679048:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154509696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744397.679057:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788744397.679669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6437e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154509696:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744398.190526:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744398.352910:0:14256:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744398.352920:0:14256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744398.352979:0:14256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788744398.352985:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788744398.511649:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744398.511659:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744398.511686:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788744398.511693:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744398.512020:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154509824:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744398.512328:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742ba1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744398.524265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744398.524317:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154509824:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744398.524448:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138712192 00000100:00100000:0.0:1788744398.524455:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138712192 00000100:00100000:0.0:1788744398.524517:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:0.0:1788744398.524526:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11413:x1875634138712192:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744398.524564:0:10509:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744398.524676:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11413:x1875634138712192:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 149us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744398.524684:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00080000:0.0:1788744398.524707:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744398.532937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744398.534193:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138712448 00000100:00100000:2.0:1788744398.534218:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138712448 00000100:00100000:2.0:1788744398.534274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:2.0:1788744398.534285:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:11413:x1875634138712448:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744398.534330:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744398.534350:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccb31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5ed expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744398.534467:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccb38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744398.534482:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccb38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744398.534569:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccb38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744398.534583:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788744398.534684:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccb31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ed expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744398.534706:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccb38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ed expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744398.534713:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:2.0:1788744398.534715:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744398.534719:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59a00, rc 0) 00000100:00100000:2.0:1788744398.534786:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:11413:x1875634138712448:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 503us (1868us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788744398.534794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:0.0:1788744398.542910:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744398.542971:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744398.543021:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138712832 00000100:00100000:1.0:1788744398.543032:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138712832 00000100:00100000:1.0:1788744398.543103:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788744398.543115:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:2396:x1875634138712832:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744398.543130:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744398.543154:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccb38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ed expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744398.543171:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744398.543176:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744398.543395:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:2396:x1875634138712832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 280us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744398.543420:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788744398.549554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138712704 00000100:00100000:3.0:1788744398.549569:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138712704 00000100:00100000:3.0:1788744398.549648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:3.0:1788744398.549659:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:11413:x1875634138712704:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788744398.549735:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.549766:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.549780:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550094:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550176:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550186:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550193:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744398.550198:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550207:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550221:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:3.0:1788744398.550224:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744398.550230:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744398.550238:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccb46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744398.550603:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:11413:x1875634138712704:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 942us (7697us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788744398.550622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000040:00080000:0.0:1788744398.551646:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744398.551656:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744398.552606:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788744398.552620:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744398.554813:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744398.554898:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713088 00000100:00100000:1.0:1788744398.554908:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713088 00000100:00100000:1.0:1788744398.554979:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788744398.554992:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:11413:x1875634138713088:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744398.555213:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:11413:x1875634138713088:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 224us (410us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788744398.555238:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788744399.214736:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154510080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.214806:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744399.214868:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154510592:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.214893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744399.214929:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154511104:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.214958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744399.214989:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788744399.214995:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154510208:0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.215021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510080 00000100:00100000:1.0:1788744399.215027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744399.215033:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510080 00000100:00100000:1.0:1788744399.215047:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154510720:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.215070:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744399.215079:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510592 00000100:00100000:0.0:1788744399.215084:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510592 00000100:00100000:1.0:1788744399.215088:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154511232:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.215113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744399.215116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511104 00000100:00100000:0.0:1788744399.215121:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511104 00000100:00100000:0.0:1788744399.215141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510720 00000100:00100000:0.0:1788744399.215145:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510720 00000100:00080000:1.0:1788744399.215150:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744399.215171:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744399.215183:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788744399.215193:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154510080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.215253:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154510080:12345-0@lo:400:kworker.0 Request processed in 62us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.215264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788744399.215280:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511232 00000100:00100000:0.0:1788744399.215284:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511232 00000100:00100000:3.0:1788744399.215299:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154509952:0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.215309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788744399.215318:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154510592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.215339:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744399.215357:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154510592:12345-0@lo:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.215364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788744399.215377:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154510464:0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.215383:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788744399.215393:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154511104:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788744399.217194:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744399.217243:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154510080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.217256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154510592:0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.217312:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510208 00000100:00100000:1.0:1788744399.217318:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510208 00000100:00100000:1.0:1788744399.217362:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788744399.217369:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.222720:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154510336:0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.224652:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154511104:12345-0@lo:400:kworker.0 Request processed in 9253us (9685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.224666:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788744399.224705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788744399.224718:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154510720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.224768:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154510720:12345-0@lo:400:kworker.0 Request processed in 55us (9697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.224774:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788744399.224786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788744399.224793:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154511232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.224822:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154511232:12345-0@lo:400:kworker.0 Request processed in 30us (9711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.224841:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00010000:0.0:1788744399.225455:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788744399.226025:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643ef0a80 x1875634154510720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744399.226041:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154510720:0@lo:400:kworker.0 00010000:00080000:0.0:1788744399.226054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75325c700 x1875634154511232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744399.226062:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154511232:0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.226073:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154511104:0@lo:400:kworker.0 00000001:00080000:0.0:1788744399.228231:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788744399.228524:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154510208:12345-0@lo:400:kworker.0 Request processed in 11149us (13493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744399.228551:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000001:00080000:0.0:1788744399.228623:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788744399.228625:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154510208:0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.229859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744399.229912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154510976:0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.229964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744399.229981:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154511488:0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.230005:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744399.230054:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154509952 00000100:00100000:3.0:1788744399.230061:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154509952 00000100:00100000:3.0:1788744399.230104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788744399.230110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510464 00000100:00100000:3.0:1788744399.230112:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154509952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.230114:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510464 00000100:00100000:1.0:1788744399.230137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788744399.230143:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154510464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.230162:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154509952:12345-0@lo:400:kworker.0 Request processed in 51us (14824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744399.230169:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788744399.230177:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154510464:12345-0@lo:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744399.230183:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788744399.230197:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510976 00000100:00100000:3.0:1788744399.230200:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510976 00000100:00080000:1.0:1788744399.230221:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744399.230230:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511488 00000100:00100000:3.0:1788744399.230233:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511488 00000100:00100000:1.0:1788744399.230238:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788744399.230244:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154510976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.230256:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788744399.230261:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6437e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154511488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744399.230274:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154510976:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744399.230280:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788744399.230286:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6437e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154511488:12345-0@lo:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744399.230291:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788744399.230304:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744399.230329:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154509952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.230341:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154510464:0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.230349:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788744399.230354:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1788744399.230372:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac6424c0000, transno 4294967302 00000004:00080000:3.0:1788744399.230390:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000100:00100000:2.0:1788744399.231722:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744399.231775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510336 00000100:00100000:2.0:1788744399.231782:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510336 00000100:00100000:2.0:1788744399.231823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788744399.231831:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154510336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.231879:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154510336:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744399.231886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000004:00080000:3.0:1788744399.232010:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac643e95f80, transno 4294967305 00000100:00100000:3.0:1788744399.232020:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154510976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.232205:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154510336:0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.232217:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77cb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154510848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.232249:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744399.232277:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154511360:0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.232299:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744399.232393:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154510848 00000100:00100000:0.0:1788744399.232424:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154510848 00000100:00100000:0.0:1788744399.232486:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511360 00000100:00100000:0.0:1788744399.232490:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511360 00000100:00100000:0.0:1788744399.233714:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788744399.233731:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154510848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.233807:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154510848:12345-0@lo:400:kworker.0 Request processed in 83us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.233814:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788744399.233831:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744399.233839:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154511360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744399.233868:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154511360:12345-0@lo:400:kworker.0 Request processed in 30us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744399.233887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788744399.235358:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744399.235367:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744399.235797:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154511488:0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.236035:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77cb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154510848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744399.236055:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154511360:0@lo:400:kworker.0 00000100:00100000:3.0:1788744399.726602:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744399.730067:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154511744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744399.730140:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744399.730203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac76e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154511616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744399.730225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788744399.731240:0:10035:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381412835470ns, next at 382412833127ns, rc = 0 00000100:00100000:2.0:1788744399.731304:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511744 00000100:00100000:2.0:1788744399.731313:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511744 00000100:00100000:2.0:1788744399.731348:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511616 00000100:00100000:2.0:1788744399.731351:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511616 00000100:00100000:2.0:1788744399.731368:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788744399.731377:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875634154511744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744399.731572:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788744399.731632:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875634154511744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744399.731639:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788744399.731666:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788744399.731674:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154511616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744399.731685:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788744399.731777:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154511616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744399.731824:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788744399.731987:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154511744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744399.732000:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac76e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154511616:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1788744400.042187:0:14307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744400.042195:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744400.042239:0:14307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788744400.042246:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744400.207744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744400.207952:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713344 00000100:00100000:0.0:1788744400.207963:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713344 00000100:00100000:0.0:1788744400.208045:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:0.0:1788744400.208057:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:11433:x1875634138713344:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744400.208081:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744400.208101:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788744400.208262:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788744400.208286:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dccb54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.208303:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dccb54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.208321:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dccb54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744400.208336:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788744400.208529:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5f4 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.208545:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dccb54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5f4 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.208553:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744400.208556:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788744400.208565:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac600, rc 0) 00000100:00100000:0.0:1788744400.208621:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:11433:x1875634138713344:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 566us (890us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788744400.208628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:1.0:1788744400.215172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744400.221214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713472 00000100:00100000:0.0:1788744400.221228:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713472 00000100:00100000:0.0:1788744400.221345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:0.0:1788744400.221355:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:11433:x1875634138713472:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788744400.221426:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221442:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221453:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221539:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221547:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221554:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221560:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744400.221564:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221572:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221595:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:0.0:1788744400.221598:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744400.221603:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.221609:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dada00/0xb6207a6e76dccb62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744400.221678:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:11433:x1875634138713472:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 325us (6512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.221685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00010000:00010000:1.0:1788744400.239432:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744400.244662:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154511872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744400.244745:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.244824:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154511872 00000100:00100000:1.0:1788744400.244832:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154511872 00000100:00100000:1.0:1788744400.244875:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788744400.244883:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154511872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744400.244925:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744400.244968:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154511872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.244975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788744400.245019:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154511872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744400.305992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744400.306593:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713600 00000100:00100000:0.0:1788744400.306604:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713600 00000100:00100000:0.0:1788744400.306665:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:0.0:1788744400.306675:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2396:x1875634138713600:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788744400.306693:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744400.306840:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccb69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d5fb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744400.306870:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e12cd, atime: 0x6a9e12cd, ctime: 0x6a9e12cd, blocks: 0x8 00010000:00010000:0.0:1788744400.306890:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1788744400.306895:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744400.306905:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccb69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5fb expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.306933:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccb69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5fb expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.306964:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dada00, rc 0) 00000100:00100000:0.0:1788744400.309535:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138713600:12345-192.168.203.4@tcp:101:cat.0 Request processed in 2851us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.309549:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00080000:0.0:1788744400.309592:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744400.314029:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744400.314302:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713728 00000100:00100000:2.0:1788744400.314312:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713728 00002000:00100000:2.0:1788744400.314360:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9ac643c44700 x1875634138713728/t0(0) o3->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:676/0 lens 488/0 e 0 to 0 dl 1788744411 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744400.314371:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643c44700 with x1875634138713728 ext(0->4095) 00002000:00010000:2.0:1788744400.314376:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643c44700 00000100:00100000:2.0:1788744400.314442:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788744400.314452:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2397:x1875634138713728:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:2.0:1788744400.314812:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2397:x1875634138713728:12345-192.168.203.4@tcp:3:cat.0 Request processed in 361us (791us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788744400.314820:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:2.0:1788744400.314827:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9ac643c44700 x1875634138713728/t0(0) o3->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:676/0 lens 488/4536 e 0 to 0 dl 1788744411 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744400.314836:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643c44700 with x1875634138713728 ext(0->4095) 00002000:00010000:2.0:1788744400.314840:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643c44700 00000100:00100000:1.0:1788744400.754821:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154512000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744400.755019:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744400.755354:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512000 00000100:00100000:2.0:1788744400.755362:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512000 00000100:00100000:2.0:1788744400.755459:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788744400.755469:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154512000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744400.755520:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744400.755580:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154512000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.755587:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788744400.756225:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154512000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744400.910878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744400.910939:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744400.910976:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744400.911003:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744400.911033:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744400.911064:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138714368 00000100:00100000:1.0:1788744400.911074:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138714368 00000100:00100000:1.0:1788744400.911135:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713984 00000100:00100000:1.0:1788744400.911139:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713984 00000100:00100000:1.0:1788744400.911161:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138714240 00000100:00100000:1.0:1788744400.911164:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138714240 00000100:00100000:1.0:1788744400.911185:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 283 00000100:00100000:1.0:1788744400.911196:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138714368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744400.911288:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138714368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 94us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.911297:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 283 00000100:00100000:1.0:1788744400.911316:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:1.0:1788744400.911324:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138713984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744400.911350:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138713984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.911356:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:1.0:1788744400.911370:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 285 00000100:00100000:1.0:1788744400.911377:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138714240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744400.911427:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138714240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.911433:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 285 00000100:00100000:0.0:1788744400.911742:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138713856 00000100:00100000:0.0:1788744400.911747:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138713856 00000100:00100000:0.0:1788744400.911790:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 381 00000100:00100000:0.0:1788744400.911799:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138713856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744400.911830:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138713856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.911836:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 381 00000100:00080000:0.0:1788744400.911881:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744400.911886:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744400.912687:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138714112 00000100:00100000:2.0:1788744400.912696:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138714112 00000100:00100000:2.0:1788744400.912768:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:2.0:1788744400.912778:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138714112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1788744400.912811:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744400.912848:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138714112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.912856:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00010000:00010000:3.0:1788744401.270130:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744401.774730:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744401.774753:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154512128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744401.774820:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744401.774966:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512128 00000100:00100000:3.0:1788744401.774975:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512128 00000100:00100000:3.0:1788744401.775026:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788744401.775036:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154512128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744401.775072:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744401.775130:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154512128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744401.775137:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788744401.775257:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154512128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744402.290185:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744402.801383:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154512256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744402.801492:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744402.801674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512256 00000100:00100000:3.0:1788744402.801701:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512256 00000100:00100000:3.0:1788744402.801756:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788744402.801765:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154512256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744402.801800:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788744402.801852:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154512256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744402.801859:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788744402.801923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154512256:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788744403.311643:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744403.313547:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:1.0:1788744403.313560:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788744403.313599:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac774ab9480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788744403.313605:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac77cb5be00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac761d29d80 00000020:00080000:1.0:1788744403.313608:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac77cb5bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac6434f2600 00000020:00080000:1.0:1788744403.313629:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:3.0:1788744403.313764:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744403.313786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154512384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788744403.313854:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744403.313932:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512384 00000100:00100000:3.0:1788744403.313942:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512384 00000100:00100000:3.0:1788744403.313998:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744403.314008:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154512384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788744403.314152:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788744403.314155:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788744397 -> 1788744397 00002000:00010000:3.0:1788744403.314157:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1788744397 -> 1788744397 00002000:00010000:3.0:1788744403.314160:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788744397 -> 1788744397 00002000:00010000:3.0:1788744403.314162:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788744403.314205:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1875634154512384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 199us (351us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788744403.314212:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788744403.314233:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788744403.314268:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac6435a4700/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788744403.314273:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154512384:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788744403.314364:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788744403.314438:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788744403.314569:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744403.314580:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744403.314588:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744403.314594:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744403.314598:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744403.314619:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744403.314639:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744403.314641:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744403.314646:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744403.314651:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccae4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744403.315247:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1788744403.315258:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1788744404.335189:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744404.335213:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154512512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.335281:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.335342:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512512 00000100:00100000:2.0:1788744404.335350:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512512 00000100:00100000:2.0:1788744404.335392:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788744404.335422:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154512512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.335467:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154512512:12345-0@lo:400:kworker.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744404.335473:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788744404.335518:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154512512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335720:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154512768:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.335781:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154513280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335803:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.335820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154513792:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335838:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.335856:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788744404.335861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154512640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335880:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.335911:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154513152:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335936:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.335954:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154513664:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.335973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.335999:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512768 00000100:00100000:1.0:1788744404.336004:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512768 00000100:00100000:1.0:1788744404.336033:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788744404.336039:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154512768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336078:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154512768:12345-0@lo:400:kworker.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.336085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788744404.336104:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513280 00000100:00100000:1.0:1788744404.336107:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513280 00000100:00100000:1.0:1788744404.336133:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513792 00000100:00100000:1.0:1788744404.336136:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513792 00000100:00100000:1.0:1788744404.336149:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512640 00000100:00100000:1.0:1788744404.336151:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512640 00000100:00100000:1.0:1788744404.336162:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513152 00000100:00100000:1.0:1788744404.336163:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513152 00000100:00100000:1.0:1788744404.336172:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513664 00000100:00100000:1.0:1788744404.336175:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513664 00000100:00100000:1.0:1788744404.336198:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788744404.336203:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154513280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336232:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154513280:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.336237:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788744404.336248:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788744404.336254:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336280:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154513792:12345-0@lo:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.336285:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788744404.336297:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788744404.336302:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154512640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336327:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154512640:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.336332:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788744404.336343:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788744404.336348:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336372:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154513152:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.336377:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788744404.336387:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788744404.336392:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154513664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336441:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154513664:12345-0@lo:400:kworker.0 Request processed in 49us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.336447:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1788744404.336486:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744404.336490:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744404.336511:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154512640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336522:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154513152:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154513664:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.336540:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154512768:0@lo:400:kworker.0 00010000:00080000:1.0:1788744404.336551:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643e92a00 x1875634154513280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744404.336561:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154513280:0@lo:400:kworker.0 00010000:00080000:1.0:1788744404.336570:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643e93800 x1875634154513792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744404.336578:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154513792:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.336747:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154512896:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.336778:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.336806:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154513408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.336831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.336860:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154513920:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.336894:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.336915:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744404.336921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.336943:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.336960:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154513536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.336979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.336995:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154514048:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337012:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744404.337037:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513408 00000100:00100000:2.0:1788744404.337042:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513408 00000100:00100000:2.0:1788744404.337069:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513920 00000100:00100000:2.0:1788744404.337071:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513920 00000100:00100000:2.0:1788744404.337083:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513536 00000100:00100000:2.0:1788744404.337085:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513536 00000100:00100000:2.0:1788744404.337095:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514048 00000100:00100000:2.0:1788744404.337097:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514048 00000100:00100000:2.0:1788744404.337108:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788744404.337115:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154513408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337155:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154513408:12345-0@lo:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744404.337161:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788744404.337177:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788744404.337183:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154513920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337230:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154513920:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744404.337236:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788744404.337258:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788744404.337266:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154513536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337296:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154513536:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744404.337302:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788744404.337315:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788744404.337322:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154514048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337351:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154514048:12345-0@lo:400:kworker.0 Request processed in 30us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744404.337357:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788744404.337384:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154513024 00000100:00100000:2.0:1788744404.337387:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154513024 00000100:00100000:2.0:1788744404.337439:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744404.337447:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337477:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154513024:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744404.337483:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788744404.337503:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744404.337507:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744404.337528:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337537:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154513536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337545:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788744404.337549:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac643e95c00, transno 4294967310 00000004:00080000:2.0:1788744404.337560:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788744404.337577:0:3645:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ac6435a4700 x1875634154512384/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788744419 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744404.337599:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154514048:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337611:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154513408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744404.337619:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154513920:0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.338023:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154512896 00000100:00100000:1.0:1788744404.338029:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154512896 00000100:00100000:1.0:1788744404.338057:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788744404.338064:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154512896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744404.338113:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154512896:12345-0@lo:400:kworker.0 Request processed in 50us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.338119:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788744404.338176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154512896:0@lo:400:kworker.0 00010000:00010000:0.0:1788744404.338394:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744404.846322:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744404.846436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138714496 00000100:00100000:0.0:1788744404.846447:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138714496 00000100:00080000:2.0:1788744404.846489:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744404.846517:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:0.0:1788744404.846527:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:11087:x1875634138714496:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788744404.846650:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:11087:x1875634138714496:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 124us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744404.846658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:3.0:1788744404.847290:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744404.847310:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154514176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744404.847370:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744404.847421:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744404.847433:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154514304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744404.847469:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744404.847546:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514176 00000100:00100000:0.0:1788744404.847552:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514176 00000100:00100000:0.0:1788744404.847577:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514304 00000100:00100000:0.0:1788744404.847581:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514304 00000100:00100000:0.0:1788744404.847594:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788744404.847601:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154514176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744404.847626:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788744404.847674:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154514176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744404.847681:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788744404.847696:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788744404.847702:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154514304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744404.847712:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788744404.847745:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154514304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744404.847752:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788744404.847790:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154514176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744404.848319:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154514304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744404.848963:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744404.855768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138714624 00000100:00100000:1.0:1788744404.855786:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138714624 00000100:00100000:1.0:1788744404.855902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00100000:1.0:1788744404.855913:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:11087:x1875634138714624:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788744404.856133:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:11087:x1875634138714624:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 221us (7172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744404.856142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00080000:2.0:1788744404.856523:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744404.869510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744404.869662:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138714880 00000100:00100000:0.0:1788744404.869672:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138714880 00000100:00100000:0.0:1788744404.869736:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788744404.869747:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:11087:x1875634138714880:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788744404.869987:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:11087:x1875634138714880:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 241us (483us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788744404.870010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00010000:00010000:0.0:1788744405.358562:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744405.358756:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154514432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744405.358817:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744405.359636:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514432 00000100:00100000:0.0:1788744405.359646:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514432 00000100:00100000:0.0:1788744405.359700:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788744405.359709:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154514432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744405.359740:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744405.362563:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154514432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2845us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744405.362578:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788744405.367997:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154514432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744405.870547:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744405.870569:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75325c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154514560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744405.870637:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744405.870798:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514560 00000100:00100000:2.0:1788744405.870807:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514560 00000100:00100000:2.0:1788744405.870854:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788744405.870864:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154514560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744405.870894:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744405.870944:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154514560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744405.870950:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788744405.870997:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75325c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154514560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744406.041099:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744406.041149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744406.041227:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715136 00000100:00100000:2.0:1788744406.041236:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715136 00000100:00100000:2.0:1788744406.041311:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:2.0:1788744406.041321:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2394:x1875634138715136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744406.041396:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2394:x1875634138715136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744406.041439:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:3.0:1788744406.041986:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715008 00000100:00100000:3.0:1788744406.041993:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715008 00000100:00100000:3.0:1788744406.042026:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 383 00000100:00100000:3.0:1788744406.042034:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138715008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744406.042086:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75e0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138715008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744406.042093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 383 00000100:00080000:0.0:1788744406.042697:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744406.052839:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744406.052901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744406.052929:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744406.052954:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744406.053001:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744406.053036:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715648 00000100:00100000:0.0:1788744406.053046:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715648 00000100:00100000:0.0:1788744406.053098:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715264 00000100:00100000:0.0:1788744406.053101:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715264 00000100:00100000:0.0:1788744406.053118:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715776 00000100:00100000:0.0:1788744406.053121:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715776 00000100:00100000:0.0:1788744406.053137:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:0.0:1788744406.053154:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138715648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744406.053222:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138715648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744406.053229:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:0.0:1788744406.053246:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 294 00000100:00100000:0.0:1788744406.053253:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138715264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744406.053278:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138715264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744406.053284:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 294 00000100:00100000:0.0:1788744406.053297:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:0.0:1788744406.053303:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138715776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744406.053326:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138715776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744406.053332:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00080000:0.0:1788744406.053348:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744406.053352:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744406.053556:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715392 00000100:00100000:2.0:1788744406.053561:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715392 00000100:00100000:2.0:1788744406.053607:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138715520 00000100:00100000:2.0:1788744406.053611:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138715520 00000100:00100000:2.0:1788744406.053635:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1788744406.053643:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75325c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138715392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744406.053671:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75325c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138715392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744406.053678:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1788744406.053691:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:2.0:1788744406.053698:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138715520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744406.053719:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138715520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744406.053724:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00080000:0.0:1788744406.054571:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744406.054590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788744406.191090:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744406.382559:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744406.592164:0:14504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:26:46 (1788744406) 00000040:00080000:0.0:1788744406.769390:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744406.769441:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744406.769529:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788744406.769537:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744406.894686:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154514688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744406.894805:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744406.894930:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514688 00000100:00100000:3.0:1788744406.894939:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514688 00000100:00100000:3.0:1788744406.894991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788744406.895001:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154514688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744406.895032:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788744406.895105:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154514688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744406.895127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788744406.895314:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154514688:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744407.406573:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744407.663166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744407.663275:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716032 00000100:00100000:0.0:1788744407.663285:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716032 00000100:00100000:0.0:1788744407.663452:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:0.0:1788744407.663463:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:12153:x1875634138716032:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744407.663484:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744407.663504:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccb70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d602 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663575:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663589:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663601:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663616:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663623:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663630:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663738:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccb85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663748:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccb85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663756:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccb85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744407.663779:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788744407.663875:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663883:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663889:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663895:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744407.663899:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663906:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663917:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac64354df00) 00010000:00010000:0.0:1788744407.663920:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744407.663925:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663931:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccb77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663946:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663952:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663968:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663974:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744407.663977:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663983:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.663991:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ac6424c9e00) 00010000:00010000:0.0:1788744407.663993:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744407.663996:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.664001:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccb7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.664263:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccb70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d602 expref: 17 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.664280:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccb85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d602 expref: 16 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744407.664287:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:0.0:1788744407.664289:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744407.664292:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dacc00, rc 0) 00000100:00100000:0.0:1788744407.664364:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:12153:x1875634138716032:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 902us (1207us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788744407.664380:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:2.0:1788744407.674089:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744407.674187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744407.674802:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716288 00000100:00100000:3.0:1788744407.674813:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716288 00000100:00100000:3.0:1788744407.674888:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788744407.674899:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:2397:x1875634138716288:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744407.674914:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744407.674939:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccb85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d602 expref: 16 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744407.674959:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:3.0:1788744407.674963:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744407.675016:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:2397:x1875634138716288:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744407.675023:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788744407.677672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716160 00000100:00100000:1.0:1788744407.677688:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716160 00000100:00100000:3.0:1788744407.677847:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:3.0:1788744407.677873:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:12153:x1875634138716160:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788744407.677992:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:12153:x1875634138716160:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 134us (3911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744407.678000:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:2.0:1788744407.700232:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744407.700383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716416 00000100:00100000:3.0:1788744407.700393:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716416 00000100:00100000:3.0:1788744407.700484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:3.0:1788744407.700495:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:12153:x1875634138716416:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788744407.700607:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:12153:x1875634138716416:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744407.700628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000040:00080000:0.0:1788744407.790556:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744407.790565:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744407.790584:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788744407.790591:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744407.918800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154514816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744407.918881:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744407.919045:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514816 00000100:00100000:3.0:1788744407.919054:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514816 00000100:00100000:3.0:1788744407.919140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788744407.919150:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154514816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744407.919182:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788744407.919239:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154514816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744407.919247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788744407.919291:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154514816:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788744408.239209:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744408.439296:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744409.456609:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744409.457971:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154515328:0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.458039:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744409.458097:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154515840:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.458105:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154514944:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.458158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744409.458159:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.458198:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154515456:0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.458199:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154516352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.458241:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744409.458250:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.458264:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154515968:0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.458282:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788744409.458290:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744409.458293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154515200:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.458314:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154516480:0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.458324:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744409.458346:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154515712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.458349:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.458372:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744409.458389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154515072:0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.458399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744409.458943:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515328 00000100:00100000:1.0:1788744409.458953:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515328 00000100:00100000:1.0:1788744409.458993:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515712 00000100:00100000:1.0:1788744409.458996:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515712 00000100:00100000:1.0:1788744409.459024:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788744409.459033:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154515328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.460599:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154516224:0@lo:400:kworker.0 00000100:00100000:0.0:1788744409.460725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744409.460978:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154516224 00000100:00100000:2.0:1788744409.461324:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.461342:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154515584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.461367:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.461379:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154516096:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.461436:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.461461:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515840 00000100:00100000:2.0:1788744409.461467:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515840 00000100:00100000:2.0:1788744409.461504:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154516352 00000100:00100000:2.0:1788744409.461508:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154516352 00000100:00100000:2.0:1788744409.461522:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515968 00000100:00100000:2.0:1788744409.461526:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515968 00000100:00100000:2.0:1788744409.461539:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154516480 00000100:00100000:2.0:1788744409.461542:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154516480 00000100:00100000:2.0:1788744409.461556:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788744409.461564:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154515840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.461621:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154515840:12345-0@lo:400:kworker.0 Request processed in 57us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.461627:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788744409.461643:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788744409.461649:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154516352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.461678:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154516352:12345-0@lo:400:kworker.0 Request processed in 30us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.461685:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788744409.461697:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788744409.461703:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.461735:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154515968:12345-0@lo:400:kworker.0 Request processed in 32us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.461752:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788744409.461764:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744409.461771:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154516480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.461800:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154516480:12345-0@lo:400:kworker.0 Request processed in 30us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.461805:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744409.464214:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515456 00000100:00100000:2.0:1788744409.464228:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515456 00000100:00100000:2.0:1788744409.464291:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515200 00000100:00100000:2.0:1788744409.464295:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515200 00000100:00100000:2.0:1788744409.464314:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788744409.464323:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.464440:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154515456:12345-0@lo:400:kworker.0 Request processed in 118us (6198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.464447:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788744409.464464:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788744409.464470:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.464497:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154515200:12345-0@lo:400:kworker.0 Request processed in 28us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.464502:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788744409.464555:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.464566:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154515968:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.464577:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154516480:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.465763:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154515328:12345-0@lo:400:kworker.0 Request processed in 6725us (7718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.465775:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788744409.465811:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515072 00000100:00100000:1.0:1788744409.465817:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515072 00000100:00100000:1.0:1788744409.465833:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154515584 00000100:00100000:1.0:1788744409.465835:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154515584 00000100:00100000:1.0:1788744409.465848:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154516096 00000100:00100000:1.0:1788744409.465863:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154516096 00000100:00100000:1.0:1788744409.465882:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788744409.465889:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154515712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.465928:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154515712:12345-0@lo:400:kworker.0 Request processed in 40us (7530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.465933:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788744409.465954:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788744409.465960:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154515072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.465995:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154515072:12345-0@lo:400:kworker.0 Request processed in 36us (4673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.466000:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788744409.466011:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788744409.466017:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154515584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466041:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154515584:12345-0@lo:400:kworker.0 Request processed in 26us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.466047:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788744409.466056:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788744409.466061:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154516096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466080:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154516096:12345-0@lo:400:kworker.0 Request processed in 20us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.466085:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:1.0:1788744409.466136:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744409.466145:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744409.466149:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744409.466151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744409.466268:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154515072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154515584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154516096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466825:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154515200:0@lo:400:kworker.0 00010000:00080000:1.0:1788744409.466839:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f47100 x1875634154515712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744409.466862:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154515712:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466875:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154515328:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466885:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154515840:0@lo:400:kworker.0 00000100:00100000:1.0:1788744409.466895:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154516352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.470063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154514944 00000100:00100000:2.0:1788744409.470094:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154514944 00000100:00100000:2.0:1788744409.470196:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788744409.470207:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154514944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744409.470297:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154514944:12345-0@lo:400:kworker.0 Request processed in 91us (12142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.470304:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788744409.470983:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154516224 00000100:00080000:3.0:1788744409.471253:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744409.471304:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788744409.471314:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154516224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744409.471375:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154516224:12345-0@lo:400:kworker.0 Request processed in 64us (10651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744409.471382:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00080000:3.0:1788744409.472060:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f44700 x1875634154516224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744409.472077:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154516224:0@lo:400:kworker.0 00000100:00100000:3.0:1788744409.472514:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154514944:0@lo:400:kworker.0 00000001:00080000:3.0:1788744409.478277:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788744409.478279:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1788744409.478301:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788744409.478326:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788744409.478340:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788744409.542394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.542891:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716544 00000100:00100000:1.0:1788744409.542902:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716544 00000100:00100000:1.0:1788744409.542978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:1.0:1788744409.542989:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:12195:x1875634138716544:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744409.543011:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788744409.543058:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744409.543078:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccb93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d609 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543146:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543169:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543181:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543196:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543203:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543209:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543271:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543279:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543286:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543292:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.543296:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543303:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543314:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:1.0:1788744409.543323:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.543341:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543352:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccb9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543366:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543372:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543377:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543382:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.543395:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543423:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543431:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac64354e500) 00010000:00010000:1.0:1788744409.543433:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.543436:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.543441:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccba1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.544903:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccb93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d609 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.544940:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:1.0:1788744409.544943:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.544949:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccb93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d609 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.544964:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741534000, rc 0) 00000100:00100000:1.0:1788744409.545041:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:12195:x1875634138716544:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2052us (2657us total) trans 0 rc 301/301 00000100:00100000:1.0:1788744409.545050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:3.0:1788744409.552075:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.554106:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716800 00000100:00100000:1.0:1788744409.554123:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716800 00000100:00100000:1.0:1788744409.554185:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:1.0:1788744409.554196:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:12195:x1875634138716800:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1788744409.554264:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744409.554290:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcc4f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d434 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.554308:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac744e31600) 00010000:00010000:1.0:1788744409.554318:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744409.554382:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.554396:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.554428:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.554610:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.554630:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.554638:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.556983:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557002:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557013:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744409.557031:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001e7e30b5 reply state 00000000e3e06f41 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557042:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557050:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744409.557053:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744409.557056:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788744409.557061:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788744409.557068:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557074:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557089:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557094:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.557098:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557105:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557116:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354e400) 00010000:00010000:1.0:1788744409.557118:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.557122:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557128:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccba8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744409.557145:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001e7e30b5 reply state 00000000e3e06f41 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557154:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.557159:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac64354e600) 00010000:00010000:1.0:1788744409.557162:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744409.557164:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788744409.558694:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:12195:x1875634138716800:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 4489us (6617us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788744409.558705:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:2.0:1788744409.614745:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744409.614828:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138716928 00000100:00100000:0.0:1788744409.614839:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138716928 00000100:00100000:0.0:1788744409.614909:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:0.0:1788744409.614920:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:12203:x1875634138716928:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:0.0:1788744409.614956:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744409.614979:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccbbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d610 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.615042:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccbc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.615057:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.615067:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744409.615110:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788744409.615115:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744409.615135:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.615159:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccbbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d610 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.615178:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d610 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.615186:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:0.0:1788744409.615188:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744409.615192:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac800, rc 0) 00000100:00100000:0.0:1788744409.615249:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:12203:x1875634138716928:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 331us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744409.615256:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:3.0:1788744409.671691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.671940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138717056 00000100:00100000:1.0:1788744409.671952:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138717056 00000100:00100000:1.0:1788744409.672025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:1.0:1788744409.672036:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+15:12209:x1875634138717056:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788744409.672061:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744409.672084:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccbcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d617 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672156:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672175:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672187:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672200:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672208:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672214:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672292:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccbe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672341:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744409.672380:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788744409.672383:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744409.672448:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672461:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672468:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672474:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672480:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.672484:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672490:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672501:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:1.0:1788744409.672504:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.672509:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672515:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccbd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672541:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672547:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672553:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672558:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.672561:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672567:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672575:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac64354e600) 00010000:00010000:1.0:1788744409.672578:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.672581:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672586:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccbd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672614:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccbcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d617 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672629:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d617 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.672649:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744409.672651:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788744409.672654:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535800, rc 0) 00000100:00100000:1.0:1788744409.672723:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:12209:x1875634138717056:12345-192.168.203.4@tcp:101:bash.0 Request processed in 688us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.672730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:0.0:1788744409.677285:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.677391:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138717312 00000100:00100000:1.0:1788744409.677427:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138717312 00000100:00100000:1.0:1788744409.677481:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:1.0:1788744409.677491:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+16:12209:x1875634138717312:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788744409.677511:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744409.677532:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccbe7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d61e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.677632:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.677648:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.677661:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.677729:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.677737:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.677765:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744409.678078:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788744409.678203:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678212:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678219:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678247:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678253:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678259:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678265:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.678269:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678276:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678288:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744409.678292:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744409.678304:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678311:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccbee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744409.678327:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000cf2d5e2 reply state 000000000755c7bd transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678337:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678343:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:1.0:1788744409.678345:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744409.678348:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788744409.678375:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccbe7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678388:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.678395:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744409.678397:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744409.678420:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782171800, rc 0) 00000100:00100000:1.0:1788744409.678485:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12209:x1875634138717312:12345-192.168.203.4@tcp:101:bash.0 Request processed in 994us (1208us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788744409.678493:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:2.0:1788744409.684674:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744409.684935:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138717440 00000100:00100000:0.0:1788744409.684946:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138717440 00000100:00080000:3.0:1788744409.685007:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744409.685026:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:0.0:1788744409.685037:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138717440:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744409.685057:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744409.685077:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d625 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744409.685103:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744409.685122:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788744409.685128:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744409.685136:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.685154:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.685167:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad600, rc 0) 00000100:00100000:0.0:1788744409.685229:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2394:x1875634138717440:12345-192.168.203.4@tcp:101:bash.0 Request processed in 193us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744409.685236:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788744409.688490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744409.689102:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138717568 00000100:00100000:2.0:1788744409.689113:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138717568 00000100:00100000:2.0:1788744409.689172:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1788744409.689183:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:12209:x1875634138717568:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744409.689203:0:8966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744409.689360:0:8966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d62c expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.689397:0:8966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.689442:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744409.689447:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744409.689574:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 7 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.689675:0:8966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.689692:0:8966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744409.689708:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8966:1875634154516608:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744409.689808:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744409.692023:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8966:1875634154516608:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744409.692056:0:8966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 7 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.692098:0:8966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58a00, rc 0) 00000100:00100000:2.0:1788744409.692159:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:12209:x1875634138717568:12345-192.168.203.4@tcp:101:bash.0 Request processed in 2977us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.692168:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:3.0:1788744409.693513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.693575:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138717696 00000100:00100000:1.0:1788744409.693584:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138717696 00010000:00010000:1.0:1788744409.693619:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744409.693682:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:1.0:1788744409.693693:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138717696:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744409.693707:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744409.693735:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.693750:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.693782:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dccc0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d625 expref: 7 pid: 8432 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.693799:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744409.693803:0:9517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744409.693811:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 6 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.693821:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 6 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.693864:0:9517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 6 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744409.693878:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9517:1875634154516736:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788744409.695039:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744409.698017:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9517:1875634154516736:192.168.203.4@tcp:105: 00010000:00010000:1.0:1788744409.698043:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744409.698161:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138717696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4468us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.698172:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1788744409.701013:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.701094:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138717952 00000100:00100000:1.0:1788744409.701115:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138717952 00000100:00100000:1.0:1788744409.701184:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1788744409.701194:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12209:x1875634138717952:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788744409.701834:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:12209:x1875634138717952:12345-192.168.203.4@tcp:35:bash.0 Request processed in 638us (826us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788744409.701842:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1788744409.786845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744409.787034:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138718208 00000100:00100000:2.0:1788744409.787049:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138718208 00000100:00100000:2.0:1788744409.787175:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:2.0:1788744409.787190:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:12219:x1875634138718208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744409.787227:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744409.787254:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccc18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d633 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744409.787373:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788744409.787549:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccc18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d633 expref: 22 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.787563:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:2.0:1788744409.787565:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744409.787571:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccc18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d633 expref: 22 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.787584:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58e00, rc 0) 00000100:00100000:2.0:1788744409.787644:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12219:x1875634138718208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 459us (814us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788744409.787652:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:3.0:1788744409.796794:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744409.796967:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138718464 00000100:00100000:2.0:1788744409.796984:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138718464 00000100:00100000:2.0:1788744409.797064:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788744409.797075:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12219:x1875634138718464:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744409.797328:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:12219:x1875634138718464:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 253us (559us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788744409.797336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1788744409.883747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.884119:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138718592 00000100:00100000:1.0:1788744409.884129:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138718592 00000100:00100000:1.0:1788744409.884200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:1.0:1788744409.884211:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:12225:x1875634138718592:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744409.884235:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744409.884254:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d63a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.884341:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dccc2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.884356:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dccc2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.884385:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dccc2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744409.884454:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788744409.884458:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744409.884476:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dccc2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.884501:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d63a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.884520:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dccc2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d63a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.884528:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744409.884531:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744409.884534:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170200, rc 0) 00000100:00100000:1.0:1788744409.885558:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:12225:x1875634138718592:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1342us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.885569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:3.0:1788744409.895542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744409.895996:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138718848 00000100:00100000:0.0:1788744409.896007:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138718848 00000100:00100000:0.0:1788744409.896082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:0.0:1788744409.896092:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:12225:x1875634138718848:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744409.896132:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744409.896155:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccc34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d641 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.896266:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.896279:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.896290:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744409.896302:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788744409.896538:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccc34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d641 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.896558:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d641 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.896809:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744409.896812:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744409.896815:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad800, rc 0) 00000100:00100000:0.0:1788744409.896892:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:12225:x1875634138718848:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 801us (1357us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788744409.896900:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:3.0:1788744409.901840:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744409.902864:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744409.902972:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138719104 00000100:00100000:2.0:1788744409.902984:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138719104 00000100:00100000:2.0:1788744409.903041:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:2.0:1788744409.903052:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:12225:x1875634138719104:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744409.903079:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744409.903099:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccc49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d648 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.903203:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccc50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.903219:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccc50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.903233:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccc50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744409.903247:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788744409.903350:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccc49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d648 expref: 28 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.903367:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccc50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d648 expref: 27 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.903388:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744409.903391:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788744409.903395:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58200, rc 0) 00000100:00100000:2.0:1788744409.903485:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12225:x1875634138719104:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 433us (1653us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788744409.903493:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:1.0:1788744409.909905:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138719232 00000100:00100000:1.0:1788744409.909925:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138719232 00000100:00100000:1.0:1788744409.910947:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1788744409.910965:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:2395:x1875634138719232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744409.910985:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744409.911011:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d641 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.911052:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744409.911058:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744409.911131:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+26:2395:x1875634138719232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 173us (8269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.911139:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788744409.915081:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744409.915335:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138719360 00000100:00100000:0.0:1788744409.915346:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138719360 00000100:00100000:0.0:1788744409.915434:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:0.0:1788744409.915460:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2396:x1875634138719360:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1788744409.915506:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.915527:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 6 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.915536:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744409.915541:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744409.915546:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.915581:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 6 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.915598:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 6 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744409.915624:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875634154516864:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744409.915716:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744409.924921:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.925081:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138719488 00000100:00100000:1.0:1788744409.925091:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138719488 00002000:00100000:1.0:1788744409.925142:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ac643fb1180 x1875634138719488/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:685/0 lens 504/0 e 0 to 0 dl 1788744420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744409.925153:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643fb1180 with x1875634138719488 ext(0->12) 00010000:00010000:1.0:1788744409.925163:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 7 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.925180:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 7 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744409.925188:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac643fb1180 00000100:00100000:1.0:1788744409.925219:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788744409.925229:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138719488:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:1.0:1788744409.926787:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2394:x1875634138719488:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 1551us (1868us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788744409.926799:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:1.0:1788744409.926811:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ac643fb1180 x1875634138719488/t4294967306(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:685/0 lens 504/448 e 0 to 0 dl 1788744420 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744409.926837:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643fb1180 with x1875634138719488 ext(0->12) 00010000:00010000:1.0:1788744409.926856:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 9 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.926877:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 9 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744409.926886:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac643fb1180 00000100:00100000:3.0:1788744409.928980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744409.930993:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875634154516864:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744409.931022:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744409.931584:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138719616 00000100:00100000:0.0:1788744409.931594:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138719616 00010000:00010000:0.0:1788744409.931637:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 9 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744409.931683:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788744409.931706:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2396:x1875634138719616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744409.931722:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788744409.931740:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788744409.931744:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788744410 00002000:00010000:0.0:1788744409.931746:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788744410 00002000:00010000:0.0:1788744409.931748:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788744410 00002000:00010000:0.0:1788744409.931750:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788744409.931757:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 9 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.931770:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 9 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.931793:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019248ffc/0xb6207a6e76dccc11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d62c expref: 9 pid: 8966 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.931810:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744409.931815:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744409.931820:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.931830:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.931940:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744409.932007:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2396:x1875634138719616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 302us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744409.932024:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00010000:00010000:3.0:1788744409.936684:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936706:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936762:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936771:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936780:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936787:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744409.936792:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936806:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936829:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.936918:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e7a57a/0xb6207a6e76dccc5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744409.937101:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138719360:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 21639us (22083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744409.937110:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1788744409.940030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.940176:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138719872 00000100:00100000:1.0:1788744409.940187:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138719872 00000100:00100000:1.0:1788744409.940253:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788744409.940264:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750211050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+26:12225:x1875634138719872:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:1.0:1788744409.940329:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccc50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d648 expref: 26 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744409.940571:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788744409.940606:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788744409.941204:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788744409.941250:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.941268:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.941278:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.941327:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.941344:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 30 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744409.941357:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875634154516992:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744409.941476:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744409.947871:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744409.948012:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138720000 00000100:00100000:3.0:1788744409.948032:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138720000 00010000:00010000:3.0:1788744409.948071:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 31 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744409.948109:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:3.0:1788744409.948119:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+31:2395:x1875634138720000:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744409.948134:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744409.948141:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 31 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.948153:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 31 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.948174:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744409.948179:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.948188:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.948195:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.948213:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744409.948260:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+31:2395:x1875634138720000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744409.948268:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00010000:00010000:1.0:1788744409.948679:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccbfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d61e expref: 30 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744409.948696:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875634154516992:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744409.948717:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.948727:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.948733:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744409.948856:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788744409.948970:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788744409.949170:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154517120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788744409.949221:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744409.949303:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744409.951886:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154517120 00000100:00100000:2.0:1788744409.951899:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154517120 00000100:00100000:2.0:1788744409.951962:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788744409.951972:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875634154517120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744409.952279:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875634154517120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 308us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.952287:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788744409.954326:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154517120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788744409.954715:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788744409.954793:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154517248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788744409.954939:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744409.955026:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744409.955116:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154517248 00000100:00100000:2.0:1788744409.955123:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154517248 00000100:00100000:2.0:1788744409.955234:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788744409.955244:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1875634154517248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744409.955378:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1875634154517248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (438us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788744409.955438:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788744409.955528:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875634154517248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788744409.955587:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788744409.955622:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.955633:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.955641:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.955647:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744409.955651:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.955658:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.955672:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744409.955675:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788744409.955680:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.955687:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc65 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744409.955775:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788744409.955864:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788744409.955876:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391637473095ns, next at 392637470802ns, rc = 0 00000001:00080000:1.0:1788744409.955882:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788744409.955904:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744409.955907:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744409.955914:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccc50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d648 expref: 34 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744409.956015:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750211050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:12225:x1875634138719872:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 15753us (15995us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788744409.956023:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000020:00080000:1.0:1788744409.956027:0:6518:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788744409.962305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744409.965933:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138720128 00000100:00100000:1.0:1788744409.965950:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138720128 00000100:00100000:1.0:1788744409.966027:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:1.0:1788744409.966038:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+33:12225:x1875634138720128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744409.966063:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744409.966085:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d64f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.966302:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d64f expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.966320:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d64f expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.966340:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744409.966344:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744409.966360:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170e00, rc 0) 00000100:00100000:1.0:1788744409.966780:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:12225:x1875634138720128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 741us (4482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.966788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:1.0:1788744409.966844:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744409.966866:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154517376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744409.966921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744409.967257:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154517376 00000100:00100000:0.0:1788744409.967265:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154517376 00000100:00100000:0.0:1788744409.967307:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788744409.967316:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154517376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744409.967340:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788744409.967421:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154517376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744409.967428:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788744409.971499:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154517376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744409.972230:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154517504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744409.972297:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744409.972390:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154517504 00000100:00100000:1.0:1788744409.972398:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154517504 00000100:00100000:1.0:1788744409.972474:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788744409.972484:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154517504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744409.972504:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788744409.974080:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154517504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1587us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744409.974095:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788744409.974208:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788744409.974214:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac6435a4700, transno 4294967313 00000100:00100000:0.0:1788744409.974281:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154517504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744409.978109:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744409.978255:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138720384 00000100:00100000:2.0:1788744409.978265:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138720384 00000100:00100000:2.0:1788744409.978321:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788744409.978332:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:12225:x1875634138720384:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744409.979029:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:12225:x1875634138720384:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 694us (924us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788744409.979038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788744410.095085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744410.095450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138720640 00000100:00100000:0.0:1788744410.095462:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138720640 00000100:00100000:0.0:1788744410.095524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:0.0:1788744410.095535:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:12235:x1875634138720640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744410.095562:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744410.095584:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d656 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744410.095696:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788744410.095808:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d656 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.096075:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:0.0:1788744410.096078:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744410.096085:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccc73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d656 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.096103:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad800, rc 0) 00000100:00100000:0.0:1788744410.096167:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:12235:x1875634138720640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 634us (1091us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788744410.096174:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1788744410.103061:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744410.103147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138720768 00000100:00100000:3.0:1788744410.103158:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138720768 00000100:00100000:3.0:1788744410.103219:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:3.0:1788744410.103230:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:12235:x1875634138720768:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788744410.103305:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103323:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103335:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103347:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103355:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103360:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103493:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103502:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103508:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744410.103563:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103590:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103596:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103601:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103607:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744410.103611:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103618:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103629:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744410.103631:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744410.103636:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103641:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccc81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103960:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103968:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103973:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103985:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744410.103989:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.103996:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104005:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:3.0:1788744410.104007:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744410.104009:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104014:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccc88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104023:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104029:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104034:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104039:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfa00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744410.104041:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104047:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104071:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744410.104073:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744410.104076:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.104082:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dccc8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744410.104300:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:12235:x1875634138720768:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1065us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744410.104309:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:1.0:1788744410.107876:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744410.107993:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138721024 00000100:00100000:0.0:1788744410.108003:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138721024 00000100:00100000:0.0:1788744410.108071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:0.0:1788744410.108082:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+36:12235:x1875634138721024:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788744410.108298:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:12235:x1875634138721024:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 216us (430us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788744410.108305:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1788744410.148969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744410.149087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138721280 00000100:00100000:1.0:1788744410.149187:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138721280 00000100:00100000:1.0:1788744410.149284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:1.0:1788744410.149296:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:12238:x1875634138721280:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744410.149321:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744410.149342:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccc96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d65d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.149690:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.149724:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.149739:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.149751:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.149758:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.149765:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.150034:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.150044:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.150052:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744410.150062:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788744410.151058:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151070:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151077:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151143:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744410.151149:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151157:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151170:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744410.151173:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744410.151179:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151185:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccc9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151199:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151205:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151211:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151215:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744410.151218:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151223:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151242:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:1.0:1788744410.151245:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744410.151248:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151254:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccca4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151304:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dccc96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151321:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.151328:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744410.151330:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744410.151332:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535200, rc 0) 00000100:00100000:1.0:1788744410.151589:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:12238:x1875634138721280:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2294us (2629us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788744410.151597:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:3.0:1788744410.154814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744410.155090:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138721408 00000100:00100000:0.0:1788744410.155151:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138721408 00000100:00100000:0.0:1788744410.155311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:0.0:1788744410.155322:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:12238:x1875634138721408:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788744410.155384:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155430:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155460:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155499:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155506:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155513:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155520:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744410.155524:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155532:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155544:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744410.155547:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744410.155552:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.155559:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcccb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744410.155638:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:12238:x1875634138721408:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 317us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744410.155656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:2.0:1788744410.157668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744410.157764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138721664 00000100:00100000:3.0:1788744410.157774:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138721664 00000100:00100000:3.0:1788744410.157830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1788744410.157857:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:12238:x1875634138721664:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788744410.158080:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+40:12238:x1875634138721664:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 233us (429us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788744410.158088:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1788744410.432444:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744410.432581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138721920 00000100:00100000:3.0:1788744410.432591:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138721920 00000100:00100000:3.0:1788744410.432650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:3.0:1788744410.432669:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+40:12269:x1875634138721920:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:3.0:1788744410.432691:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744410.432709:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcccc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d664 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.432836:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcccc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.432860:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcccc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.432883:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcccc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744410.432894:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788744410.432989:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcccc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d664 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.433006:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcccc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d664 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744410.433015:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744410.433018:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744410.433021:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfa00, rc 0) 00000100:00100000:3.0:1788744410.433080:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12269:x1875634138721920:12345-192.168.203.4@tcp:101:cat.0 Request processed in 413us (683us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788744410.433087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:3.0:1788744410.438511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744410.438616:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138722176 00000100:00100000:0.0:1788744410.438641:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138722176 00000100:00100000:0.0:1788744410.438828:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788744410.438841:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12269:x1875634138722176:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:0.0:1788744410.439101:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:12269:x1875634138722176:12345-192.168.203.4@tcp:35:cat.0 Request processed in 263us (599us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788744410.439109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788744410.442473:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744410.442795:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138722304 00000100:00100000:1.0:1788744410.442806:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138722304 00000100:00100000:1.0:1788744410.442899:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788744410.442911:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:2396:x1875634138722304:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744410.442928:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744410.442955:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcccc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d664 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.443006:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744410.443011:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744410.443076:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:2396:x1875634138722304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 167us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744410.443084:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788744410.478802:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744410.478824:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154517632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744410.478903:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744410.479109:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744410.479160:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154517632 00000100:00100000:2.0:1788744410.479168:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154517632 00000100:00100000:2.0:1788744410.479221:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788744410.479231:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154517632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744410.479256:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744410.479305:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154517632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744410.479312:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788744410.479484:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154517632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744410.500198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744410.500316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138722560 00000100:00100000:1.0:1788744410.500326:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138722560 00000100:00100000:1.0:1788744410.500388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:1.0:1788744410.500399:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12275:x1875634138722560:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1788744410.500470:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744410.500474:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788744410.500502:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dccc2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d63a expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.500522:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744410.500527:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744410.500538:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcccd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d66b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.500638:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.500662:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.500692:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.500727:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.500742:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 42 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744410.500756:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154517760:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744410.500866:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74510d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744410.507133:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744410.507234:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154517760:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744410.507259:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744410.507380:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138722688 00000100:00100000:0.0:1788744410.507387:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138722688 00010000:00010000:0.0:1788744410.507470:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 43 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744410.507505:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1788744410.507514:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:2395:x1875634138722688:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744410.507527:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744410.507533:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 43 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.507544:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 43 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.507563:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcccab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d65d expref: 43 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.507591:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744410.507595:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.507604:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.507612:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.507633:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744410.507690:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:2395:x1875634138722688:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744410.507697:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00010000:00010000:1.0:1788744410.508886:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.508899:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744410.508920:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788744410.509055:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcccd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.509073:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.509096:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744410.509099:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744410.509102:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741534c00, rc 0) 00000100:00100000:1.0:1788744410.509154:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12275:x1875634138722560:12345-192.168.203.4@tcp:101:dd.0 Request processed in 8756us (8978us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788744410.509161:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:3.0:1788744410.511293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744410.511374:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138722816 00000100:00100000:0.0:1788744410.511385:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138722816 00000100:00100000:0.0:1788744410.511460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1788744410.511470:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12275:x1875634138722816:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1788744410.511492:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744410.511509:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcccea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d672 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.511542:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.511738:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.511753:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.511883:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcccea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.511902:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.511910:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744410.511913:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744410.511917:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac200, rc 0) 00000100:00100000:0.0:1788744410.512044:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:12275:x1875634138722816:12345-192.168.203.4@tcp:101:dd.0 Request processed in 574us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744410.512051:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1788744410.526016:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744410.526343:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138723072 00000100:00100000:2.0:1788744410.526354:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138723072 00000100:00100000:2.0:1788744410.526460:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:2.0:1788744410.526471:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:12275:x1875634138723072:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1788744410.526731:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.526748:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.526758:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744410.526800:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788744410.526821:0:10509:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000dae262f8 reply state 0000000068e6fb05 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.526834:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.526853:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744410.526856:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744410.526860:0:10509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744410.526942:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+46:12275:x1875634138723072:12345-192.168.203.4@tcp:36:dd.0 Request processed in 473us (935us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788744410.526950:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000020:00080000:2.0:1788744410.526954:0:10509:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788744410.832087:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744410.832188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138723200 00000100:00100000:1.0:1788744410.832199:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138723200 00000100:00100000:1.0:1788744410.834948:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:1.0:1788744410.834987:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+46:12289:x1875634138723200:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:1.0:1788744410.835013:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744410.835045:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcccff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d679 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835114:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835129:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835140:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835150:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835156:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835179:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835247:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835259:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835278:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835311:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.835326:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 47 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744410.835339:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154517888:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744410.835453:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74510d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744410.844322:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744410.844442:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138723456 00000100:00100000:3.0:1788744410.844450:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138723456 00000100:00100000:3.0:1788744410.844517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788744410.844526:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+48:6163:x1875634138723456:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744410.844816:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:6163:x1875634138723456:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 289us (500us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788744410.844824:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788744410.847545:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744410.847801:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138723584 00000100:00100000:2.0:1788744410.847810:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138723584 00010000:00010000:2.0:1788744410.847854:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 49 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744410.847894:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:2.0:1788744410.847903:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:2395:x1875634138723584:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744410.847931:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744410.847939:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 49 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.847953:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 49 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.847973:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744410.847978:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.847989:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.847997:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.848016:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744410.848070:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:2395:x1875634138723584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 168us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744410.848077:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00010000:00010000:1.0:1788744410.850212:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcccdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d66b expref: 48 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744410.850236:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875634154517888:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744410.850257:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850280:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850302:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744410.850363:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788744410.850367:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744410.850395:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850474:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850484:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850491:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850497:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850503:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744410.850506:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850513:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850528:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744410.850531:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744410.850535:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850551:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850561:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850567:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850572:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850577:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744410.850580:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850585:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850592:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:1.0:1788744410.850595:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744410.850597:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850602:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850636:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dcccff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d679 expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850662:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d679 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744410.850675:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744410.850677:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744410.850679:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535200, rc 0) 00000100:00100000:1.0:1788744410.850733:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:12289:x1875634138723200:12345-192.168.203.4@tcp:101:stat.0 Request processed in 15765us (18655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744410.850741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:3.0:1788744410.919447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744410.919574:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138723840 00000100:00100000:0.0:1788744410.919590:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138723840 00000100:00100000:0.0:1788744410.919663:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:0.0:1788744410.919674:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:12295:x1875634138723840:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:0.0:1788744410.919739:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744410.919768:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccd14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d679 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.919789:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744410.919794:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744410.919981:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.920012:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.920023:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744410.920063:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788744410.920086:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000cce7dfe6 reply state 00000000e04daa6e transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.920099:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744410.920105:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744410.920108:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744410.920111:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744410.920216:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:12295:x1875634138723840:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 543us (823us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788744410.920224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000020:00080000:0.0:1788744410.920228:0:6515:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00080000:0.0:1788744410.990945:0:8965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392672540104ns, next at 393672537443ns, rc = 0 00000100:00100000:1.0:1788744410.991029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154518016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744410.991096:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744410.991262:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154518016 00000100:00100000:3.0:1788744410.991271:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154518016 00000100:00100000:3.0:1788744410.991318:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788744410.991327:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154518016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744410.991346:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788744410.991392:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154518016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744410.991399:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788744410.991758:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154518016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744411.103946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.104363:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138723968 00000100:00100000:3.0:1788744411.104376:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138723968 00000100:00100000:3.0:1788744411.104485:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:3.0:1788744411.104498:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+49:12309:x1875634138723968:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:3.0:1788744411.104524:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744411.104546:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccd22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d680 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104623:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104638:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104662:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104674:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104681:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104688:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104761:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104770:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104776:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744411.104829:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788744411.104833:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744411.104862:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104873:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104881:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104896:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104903:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104908:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744411.104912:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104918:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104929:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744411.104931:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744411.104936:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104942:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dccd29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104954:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104960:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104965:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104970:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744411.104979:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104985:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.104993:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:3.0:1788744411.104996:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744411.104999:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.105005:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccd30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.105032:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccd22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 51 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.105045:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 50 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.105245:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744411.105248:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744411.105251:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bea00, rc 0) 00000100:00100000:3.0:1788744411.105316:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+50:12309:x1875634138723968:12345-192.168.203.4@tcp:101:stat.0 Request processed in 821us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.105322:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00080000:1.0:1788744411.105464:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744411.159072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.159126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.159160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.159211:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.159244:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.159281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.159669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724608 00000100:00100000:1.0:1788744411.159681:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724608 00000100:00100000:1.0:1788744411.159752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724224 00000100:00100000:1.0:1788744411.159756:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724224 00000100:00100000:1.0:1788744411.159773:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724736 00000100:00100000:1.0:1788744411.159776:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724736 00000100:00100000:1.0:1788744411.159793:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 302 00000100:00100000:1.0:1788744411.159802:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138724608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744411.159881:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138724608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.159887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 302 00000100:00100000:1.0:1788744411.159904:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 303 00000100:00100000:1.0:1788744411.159909:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138724224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744411.159932:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138724224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.159938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 303 00000100:00100000:1.0:1788744411.159965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 304 00000100:00100000:1.0:1788744411.159971:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138724736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744411.159996:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138724736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.160002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 304 00000100:00100000:2.0:1788744411.160198:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724096 00000100:00100000:2.0:1788744411.160203:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724096 00000100:00100000:2.0:1788744411.160288:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:2.0:1788744411.160295:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138724096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744411.160323:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138724096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.160338:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:2.0:1788744411.160366:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724352 00000100:00100000:2.0:1788744411.160370:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724352 00000100:00100000:2.0:1788744411.160393:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724480 00000100:00100000:2.0:1788744411.160396:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724480 00000100:00100000:2.0:1788744411.160463:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:2.0:1788744411.160470:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138724352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744411.160495:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138724352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.160501:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:2.0:1788744411.160511:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:2.0:1788744411.160516:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138724480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744411.160733:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138724480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 216us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.160741:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00080000:3.0:1788744411.161315:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744411.161321:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744411.161323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744411.161326:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744411.212694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.214343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138724992 00000100:00100000:1.0:1788744411.214355:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138724992 00000100:00100000:1.0:1788744411.214432:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:1.0:1788744411.214441:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+50:12319:x1875634138724992:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744411.214461:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744411.214479:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccd3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d687 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744411.214705:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788744411.214807:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccd3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d687 expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.214823:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:1.0:1788744411.214826:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744411.214831:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535400/0xb6207a6e76dccd3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d687 expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.214854:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535400, rc 0) 00000100:00100000:1.0:1788744411.214922:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+51:12319:x1875634138724992:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 481us (2235us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788744411.214929:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:2.0:1788744411.217803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.218028:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138725248 00000100:00100000:3.0:1788744411.218038:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138725248 00000100:00100000:3.0:1788744411.218093:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1788744411.218103:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750210450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+51:12319:x1875634138725248:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788744411.218495:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750210450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:12319:x1875634138725248:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 392us (699us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788744411.218502:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1788744411.289167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.290679:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138725504 00000100:00100000:2.0:1788744411.290692:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138725504 00000100:00100000:2.0:1788744411.290767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:2.0:1788744411.290779:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:12325:x1875634138725504:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744411.290804:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.291091:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccd4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d68e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.291221:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.291238:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 53 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.291248:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.291283:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 53 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.291298:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 53 pid: 7792 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744411.291311:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154518144:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744411.291482:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744411.295785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.295949:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138725632 00000100:00100000:3.0:1788744411.295959:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138725632 00010000:00010000:3.0:1788744411.296000:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 54 pid: 7792 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744411.296051:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1788744411.296062:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:2394:x1875634138725632:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744411.296077:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744411.296084:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 54 pid: 7792 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.296097:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 54 pid: 7792 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.296143:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744411.296149:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.296160:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.296167:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.296186:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744411.296245:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:2394:x1875634138725632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 184us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.296253:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00010000:00010000:0.0:1788744411.296938:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccd37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d680 expref: 53 pid: 7792 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744411.296958:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154518144:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744411.296981:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.297004:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.297020:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744411.297040:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788744411.297163:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccd4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.297179:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.297187:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744411.297190:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744411.297193:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58200, rc 0) 00000100:00100000:0.0:1788744411.297281:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:12325:x1875634138725504:12345-192.168.203.4@tcp:101:bash.0 Request processed in 6503us (8121us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788744411.297289:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:2.0:1788744411.300731:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.300815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138725888 00000100:00100000:0.0:1788744411.300835:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138725888 00000100:00100000:0.0:1788744411.300903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:0.0:1788744411.300915:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:12325:x1875634138725888:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:0.0:1788744411.301154:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.301173:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.301198:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744411.301243:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788744411.301265:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009ed029b9 reply state 00000000d8b7e7b4 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.301279:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.301286:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744411.301289:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744411.301293:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744411.301387:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12325:x1875634138725888:12345-192.168.203.4@tcp:36:bash.0 Request processed in 473us (663us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788744411.301395:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 175 00000020:00080000:0.0:1788744411.301440:0:6515:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788744411.318363:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.318745:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138726016 00000100:00100000:0.0:1788744411.318755:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138726016 00000100:00100000:0.0:1788744411.318815:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:0.0:1788744411.318826:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12325:x1875634138726016:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744411.318858:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744411.318878:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccd68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d695 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.318966:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.318983:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.319007:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.319041:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.319056:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 57 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744411.319069:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154518272:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744411.319153:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744411.323136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.323322:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138726144 00000100:00100000:1.0:1788744411.323347:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138726144 00010000:00010000:1.0:1788744411.323386:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 58 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744411.323524:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1788744411.323534:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:2395:x1875634138726144:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744411.323550:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744411.323557:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 58 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.323571:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 58 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.323594:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744411.323600:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.323610:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.323618:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.323649:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744411.323709:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:2395:x1875634138726144:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.323717:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00010000:00010000:0.0:1788744411.327314:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccd53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d68e expref: 57 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744411.327339:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154518272:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744411.327361:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.327371:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.327377:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744411.334265:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788744411.334276:0:10509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744411.334310:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.334372:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccd68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d695 expref: 57 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.334394:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d695 expref: 56 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.334526:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744411.334530:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744411.334534:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad800, rc 0) 00000100:00100000:0.0:1788744411.334620:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12325:x1875634138726016:12345-192.168.203.4@tcp:101:bash.0 Request processed in 15795us (16266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744411.334628:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:3.0:1788744411.338088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.338198:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138726400 00000100:00100000:2.0:1788744411.338208:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138726400 00000100:00100000:2.0:1788744411.338265:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:2.0:1788744411.338277:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12325:x1875634138726400:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1788744411.338546:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+57:12325:x1875634138726400:12345-192.168.203.4@tcp:35:bash.0 Request processed in 270us (465us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788744411.338570:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1788744411.404518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.404660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138726656 00000100:00100000:0.0:1788744411.404671:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138726656 00000100:00100000:0.0:1788744411.404736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:0.0:1788744411.404747:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+57:12335:x1875634138726656:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744411.404771:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744411.404791:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccd76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d69c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744411.404902:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788744411.404998:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccd76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d69c expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.405012:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:0.0:1788744411.405015:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744411.405037:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccd76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d69c expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.405054:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dace00, rc 0) 00000100:00100000:0.0:1788744411.405232:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12335:x1875634138726656:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 486us (722us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788744411.405241:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:0.0:1788744411.409523:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.409684:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138726784 00000100:00100000:1.0:1788744411.409694:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138726784 00000100:00100000:1.0:1788744411.409771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:1.0:1788744411.409782:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12335:x1875634138726784:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1788744411.409873:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.409890:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.409902:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.409914:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.409921:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.409928:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410004:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410013:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410021:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744411.410072:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410085:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410099:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410106:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410112:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744411.410117:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410125:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410139:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744411.410381:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744411.410388:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410394:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534000/0xb6207a6e76dccd84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410437:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410444:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410449:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410455:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744411.410464:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410471:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410479:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:1.0:1788744411.410481:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744411.410484:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410490:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534e00/0xb6207a6e76dccd8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410501:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410507:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410513:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410518:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744411.410521:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410527:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410535:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744411.410537:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744411.410546:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.410552:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccd92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744411.410642:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12335:x1875634138726784:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 854us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.410651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:3.0:1788744411.412817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.413016:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138727040 00000100:00100000:2.0:1788744411.413026:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138727040 00000100:00100000:2.0:1788744411.413084:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:2.0:1788744411.413095:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12335:x1875634138727040:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744411.413325:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:12335:x1875634138727040:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 231us (520us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788744411.413332:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788744411.447069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.447195:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138727296 00000100:00100000:0.0:1788744411.447205:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138727296 00000100:00100000:0.0:1788744411.447268:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:0.0:1788744411.447278:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:12338:x1875634138727296:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744411.447301:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744411.447321:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dccd99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6a3 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447396:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447462:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447473:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447484:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447490:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447514:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447630:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccdae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447649:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccdae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447657:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccdae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744411.447667:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788744411.447744:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447751:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447758:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447764:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744411.447768:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447775:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447786:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:0.0:1788744411.447789:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744411.447801:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447808:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccda0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447822:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447847:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447853:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447858:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744411.447862:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447867:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447876:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:0.0:1788744411.447878:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744411.447881:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447887:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccda7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447925:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dccd99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6a3 expref: 62 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447952:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccdae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6a3 expref: 61 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.447960:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744411.447963:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744411.447965:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad600, rc 0) 00000100:00100000:0.0:1788744411.448028:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:12338:x1875634138727296:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 751us (968us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788744411.448035:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:0.0:1788744411.463023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.463069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.463158:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138727424 00000100:00100000:3.0:1788744411.463168:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138727424 00000100:00100000:3.0:1788744411.463236:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788744411.463247:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:2397:x1875634138727424:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744411.463264:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744411.463288:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccdae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6a3 expref: 61 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.463327:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744411.463332:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744411.463393:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:2397:x1875634138727424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 148us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.463451:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788744411.463654:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138727552 00000100:00100000:2.0:1788744411.463659:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138727552 00000100:00100000:2.0:1788744411.463696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:2.0:1788744411.463704:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:12338:x1875634138727552:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1788744411.463759:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463774:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463785:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463821:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463845:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463851:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463865:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744411.463869:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463878:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463887:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744411.463890:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744411.463894:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.463900:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744411.463940:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:12338:x1875634138727552:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 237us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.463947:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:3.0:1788744411.470497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.470632:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138727808 00000100:00100000:2.0:1788744411.470642:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138727808 00000100:00100000:2.0:1788744411.470708:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1788744411.470718:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:12338:x1875634138727808:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744411.470943:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:12338:x1875634138727808:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 226us (455us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788744411.470951:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00010000:00010000:1.0:1788744411.503432:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744411.609244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.609454:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138728064 00000100:00100000:2.0:1788744411.609465:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138728064 00000100:00100000:2.0:1788744411.609516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:2.0:1788744411.609537:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+61:12356:x1875634138728064:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:2.0:1788744411.609562:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.609583:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6aa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.609691:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccdca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.609705:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccdca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.609716:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccdca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744411.609728:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744411.609861:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6aa expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.609881:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccdca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6aa expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.609890:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744411.609893:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788744411.609896:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58200, rc 0) 00000100:00100000:2.0:1788744411.609961:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12356:x1875634138728064:12345-192.168.203.4@tcp:101:cat.0 Request processed in 425us (725us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788744411.609969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:0.0:1788744411.636672:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.636820:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138728192 00000100:00100000:2.0:1788744411.636831:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138728192 00000100:00100000:2.0:1788744411.636921:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:2.0:1788744411.636933:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12357:x1875634138728192:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744411.636961:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.636983:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6b1 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.637052:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccddf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.637067:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.637078:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744411.637119:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788744411.637123:0:10509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744411.637153:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.637181:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccdd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b1 expref: 65 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.637199:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccddf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b1 expref: 64 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.637208:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744411.637210:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744411.637214:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58e00, rc 0) 00000100:00100000:2.0:1788744411.637278:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12357:x1875634138728192:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 346us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.637291:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:3.0:1788744411.642120:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.642259:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138728576 00000100:00100000:2.0:1788744411.642268:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138728576 00000100:00100000:2.0:1788744411.642321:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1788744411.642331:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12357:x1875634138728576:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744411.642639:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12357:x1875634138728576:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 308us (526us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788744411.642804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:1.0:1788744411.644986:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.645079:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138728704 00000100:00100000:2.0:1788744411.645088:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138728704 00000100:00100000:1.0:1788744411.645230:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788744411.645242:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12357:x1875634138728704:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:1.0:1788744411.645258:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788744411.645281:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccd6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d695 expref: 65 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.645304:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccdca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6aa expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.645318:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dccc6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d64f expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.645330:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744411.645335:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744411.645386:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:12357:x1875634138728704:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 147us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.645886:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788744411.647864:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.647979:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138728832 00000100:00100000:3.0:1788744411.647989:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138728832 00000100:00100000:3.0:1788744411.648045:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:3.0:1788744411.648054:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:12357:x1875634138728832:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:3.0:1788744411.648260:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.648278:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.648290:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744411.648393:0:7792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788744411.649331:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:12357:x1875634138728832:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 1272us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.649341:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:3.0:1788744411.672496:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.672816:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138728960 00000100:00100000:0.0:1788744411.672826:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138728960 00000100:00100000:0.0:1788744411.672893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:0.0:1788744411.672904:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+62:12359:x1875634138728960:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744411.672926:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744411.672947:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dccded lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673014:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673029:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673059:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673071:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673079:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673086:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673167:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673177:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673184:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744411.673226:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788744411.673230:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744411.673250:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673263:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673271:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673288:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673295:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673302:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744411.673306:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673314:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673326:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:0.0:1788744411.673329:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744411.673333:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673340:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dccdf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673354:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673360:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673366:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673371:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dace00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744411.673381:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673388:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673396:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:0.0:1788744411.673446:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744411.673450:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673457:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dccdfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673484:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dccded lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673499:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.673506:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:0.0:1788744411.673508:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744411.673511:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dade00, rc 0) 00000100:00100000:0.0:1788744411.673582:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12359:x1875634138728960:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 679us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744411.673590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 184 00000040:00080000:3.0:1788744411.886808:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744411.886832:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744411.886877:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788744411.886887:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744411.887029:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154518400:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744411.887358:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744411.892767:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744411.893022:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154518400:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744411.893355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138729088 00000100:00100000:2.0:1788744411.893363:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138729088 00000100:00100000:2.0:1788744411.893582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:2.0:1788744411.893595:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12370:x1875634138729088:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744411.893630:0:6515:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744411.893762:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12370:x1875634138729088:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 168us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.893771:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:1.0:1788744411.898206:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.898354:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138729216 00000100:00100000:3.0:1788744411.898363:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138729216 00000100:00100000:3.0:1788744411.898466:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:3.0:1788744411.898478:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12370:x1875634138729216:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788744411.898558:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898576:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898587:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898655:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898663:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898670:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898698:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898706:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898727:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744411.898773:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788744411.898777:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744411.898790:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898801:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898808:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898814:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898844:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744411.898849:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898857:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898868:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:3.0:1788744411.898871:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744411.898877:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898883:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcce09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898910:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898916:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898922:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898927:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744411.898930:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898936:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898945:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9ac74505f300) 00010000:00010000:3.0:1788744411.898948:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744411.898951:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898956:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898971:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898978:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898983:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.898995:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bec00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744411.898998:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.899005:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.899014:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744411.899016:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744411.899020:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.899025:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744411.899104:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12370:x1875634138729216:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 627us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.899113:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:0.0:1788744411.903156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.903371:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138729472 00000100:00100000:2.0:1788744411.903384:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138729472 00000100:00100000:2.0:1788744411.903483:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:2.0:1788744411.903492:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12370:x1875634138729472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744411.903511:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.903531:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcce1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6bf expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904005:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904025:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904037:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744411.904049:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744411.904125:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904133:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904210:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904218:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744411.904222:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904230:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904241:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744411.904244:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744411.904249:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904267:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904310:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcce1e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6bf expref: 65 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904320:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:2.0:1788744411.904323:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744411.904326:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcce1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6bf expref: 65 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.904336:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744411.904515:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12370:x1875634138729472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1023us (1378us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788744411.904523:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:1.0:1788744411.907655:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.907729:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138729600 00000100:00100000:2.0:1788744411.907739:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138729600 00000100:00100000:2.0:1788744411.907795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:2.0:1788744411.907806:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12370:x1875634138729600:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744411.907850:0:6516:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744411.907987:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12370:x1875634138729600:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 182us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.907995:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:1.0:1788744411.913739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.914002:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138729856 00000100:00100000:2.0:1788744411.914012:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138729856 00000100:00100000:2.0:1788744411.914076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:2.0:1788744411.914102:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12370:x1875634138729856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744411.914122:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.914125:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744411.914164:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dccddf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b1 expref: 64 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.914183:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744411.914189:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744411.914201:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcce33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744411.914601:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788744411.914755:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.914769:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.914778:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.914827:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcce33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6c6 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.914854:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6c6 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.914862:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac76020ca00) 00010000:00010000:2.0:1788744411.914865:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744411.914876:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59600, rc 0) 00000100:00100000:2.0:1788744411.914932:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac64365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12370:x1875634138729856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 832us (1204us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788744411.914940:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:1.0:1788744411.921254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.921344:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138730112 00000100:00100000:2.0:1788744411.921357:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138730112 00000100:00100000:2.0:1788744411.921461:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:2.0:1788744411.921472:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12370:x1875634138730112:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744411.921530:0:10509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744411.921562:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6c6 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921584:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac76020ca00) 00010000:00010000:2.0:1788744411.921596:0:10509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744411.921621:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921646:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921657:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921672:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921679:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921686:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921749:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921757:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921763:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921770:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744411.921774:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921782:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921791:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744411.921793:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744411.921797:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921802:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921813:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921819:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921825:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921848:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744411.921851:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921857:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921866:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x22560104 (ffff9ac76020c800) 00010000:00010000:2.0:1788744411.921868:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744411.921871:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.921877:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcce4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x22560104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744411.921965:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac76e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12370:x1875634138730112:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 493us (722us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744411.921972:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:1.0:1788744411.924734:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.924863:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138730240 00000100:00100000:3.0:1788744411.924875:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138730240 00000100:00100000:3.0:1788744411.924931:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:3.0:1788744411.924941:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12370:x1875634138730240:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744411.924962:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744411.924986:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6cd expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.925021:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.925054:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.925066:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.925191:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 66 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.925211:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 65 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.925219:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:3.0:1788744411.925222:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744411.925226:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:3.0:1788744411.925284:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12370:x1875634138730240:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 344us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.925291:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:3.0:1788744411.928300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.928502:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138730496 00000100:00100000:1.0:1788744411.928514:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138730496 00000100:00100000:1.0:1788744411.928572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:1.0:1788744411.928584:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12370:x1875634138730496:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744411.928686:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.928705:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.928718:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744411.928894:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788744411.928905:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393610502226ns, next at 394610499586ns, rc = 0 00000004:00010000:1.0:1788744411.928953:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000022d4a2ff reply state 00000000d876ac6b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.928965:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.928972:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:1.0:1788744411.928975:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788744411.928990:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744411.929091:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12370:x1875634138730496:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 508us (800us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788744411.929100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:0.0:1788744411.936742:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.941397:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138730624 00000100:00100000:2.0:1788744411.941426:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138730624 00000100:00100000:2.0:1788744411.941490:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:2.0:1788744411.941501:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12370:x1875634138730624:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744411.941528:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.941547:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.941603:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.941633:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.941655:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:2.0:1788744411.941658:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744411.941662:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59400, rc 0) 00000100:00100000:2.0:1788744411.941727:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:12370:x1875634138730624:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 228us (4995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.941734:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:0.0:1788744411.950927:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.951017:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138730752 00000100:00100000:2.0:1788744411.951026:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138730752 00000100:00100000:2.0:1788744411.951225:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788744411.951236:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+6:2395:x1875634138730752:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788744411.951491:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138730752:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 256us (573us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788744411.951498:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788744411.959086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.959187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138731008 00000100:00100000:3.0:1788744411.959199:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138731008 00000100:00100000:3.0:1788744411.959256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1788744411.959267:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:12370:x1875634138731008:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744411.959522:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:12370:x1875634138731008:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 256us (445us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788744411.959530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788744411.963966:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.964046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138731264 00000100:00100000:1.0:1788744411.964058:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138731264 00000100:00100000:1.0:1788744411.964119:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:1.0:1788744411.964130:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:12370:x1875634138731264:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744411.964252:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:12370:x1875634138731264:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.964261:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:0.0:1788744411.977753:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744411.979830:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138731392 00000100:00100000:2.0:1788744411.979850:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138731392 00000100:00100000:2.0:1788744411.979906:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:2.0:1788744411.979917:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:12370:x1875634138731392:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744411.979938:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.979960:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6db expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.980049:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.980064:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.980077:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744411.980121:0:10509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744411.980258:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.980297:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcce72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6db expref: 71 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.980312:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6db expref: 70 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.980321:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:2.0:1788744411.980324:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744411.980328:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59600, rc 0) 00000100:00100000:2.0:1788744411.980457:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+70:12370:x1875634138731392:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 540us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.980464:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:2.0:1788744411.983190:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744411.983338:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138731520 00000100:00100000:3.0:1788744411.983349:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138731520 00000100:00100000:3.0:1788744411.983439:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788744411.983450:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138731520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744411.983469:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744411.983489:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6e2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744411.983512:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e12dc, blocks: 0x0 00010000:00010000:3.0:1788744411.983533:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1788744411.983538:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744411.983547:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.983564:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744411.983577:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bec00, rc 0) 00000100:00100000:3.0:1788744411.983638:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138731520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 189us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.983645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1788744411.995901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744411.995982:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138731776 00000100:00100000:1.0:1788744411.995993:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138731776 00000100:00100000:1.0:1788744411.996056:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:1.0:1788744411.996067:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+70:12370:x1875634138731776:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744411.996189:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+70:12370:x1875634138731776:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744411.996197:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:1.0:1788744412.002675:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.002748:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138731904 00000100:00100000:3.0:1788744412.002758:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138731904 00000100:00100000:3.0:1788744412.002866:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1788744412.002877:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:12370:x1875634138731904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744412.002895:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744412.002921:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6e9 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.002954:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.002964:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744412.002968:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744412.002974:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.003005:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.003021:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.003035:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875634154518528:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744412.003131:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744412.005132:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875634154518528:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744412.005175:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.005194:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf200, rc 0) 00000100:00100000:0.0:1788744412.005250:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:12370:x1875634138731904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2373us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744412.005258:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788744412.006526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.006603:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138732032 00000100:00100000:3.0:1788744412.006612:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138732032 00010000:00010000:3.0:1788744412.006659:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.006702:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:3.0:1788744412.006711:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2394:x1875634138732032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744412.006753:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744412.006775:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.006790:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.006810:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85de53f/0xb6207a6e76dcce80 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e2 expref: 9 pid: 8432 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.006946:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744412.006951:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744412.006960:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.006971:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.007006:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.007020:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875634154518656:192.168.203.4@tcp:105: 00000100:00100000:3.0:1788744412.007340:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744412.011816:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744412.015557:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875634154518656:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788744412.015601:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744412.015680:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138732032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8967us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744412.015692:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:2.0:1788744412.015738:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138732160 00000100:00100000:2.0:1788744412.015746:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138732160 00002000:00100000:2.0:1788744412.015785:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ac643e46a00 x1875634138732160/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:688/0 lens 504/0 e 0 to 0 dl 1788744423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744412.015796:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643e46a00 with x1875634138732160 ext(0->8) 00002000:00010000:2.0:1788744412.015802:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643e46a00 00000100:00100000:2.0:1788744412.015995:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788744412.016006:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138732160:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788744412.018248:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2395:x1875634138732160:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 2233us (6431us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788744412.018261:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00002000:00100000:2.0:1788744412.018273:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ac643e46a00 x1875634138732160/t4294967315(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:688/0 lens 504/448 e 0 to 0 dl 1788744423 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744412.018285:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643e46a00 with x1875634138732160 ext(0->8) 00002000:00010000:2.0:1788744412.018291:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643e46a00 00000100:00100000:3.0:1788744412.022041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154518784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744412.022120:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744412.028274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744412.028423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138732288 00000100:00100000:1.0:1788744412.028432:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138732288 00000100:00100000:1.0:1788744412.028482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:1.0:1788744412.028492:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+70:12370:x1875634138732288:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788744412.031856:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154518784 00000100:00100000:2.0:1788744412.031872:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154518784 00000100:00100000:2.0:1788744412.031942:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788744412.031954:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154518784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744412.031994:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788744412.032114:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154518784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (9994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744412.032132:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788744412.032739:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154518784:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788744412.033120:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788744412.033133:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:3.0:1788744412.033505:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033518:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033527:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033534:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.033539:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033547:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033564:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac64354e600) 00010000:00010000:3.0:1788744412.033567:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.033573:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033579:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dccbaf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033599:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033605:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033622:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.033627:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.033630:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744412.034016:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788744412.034047:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788744412.034057:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac77cc4b6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788744412.034061:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac7447e5c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac77cc4bd80 00000020:00080000:2.0:1788744412.034064:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac7447e5900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac6437ff000 00010000:00010000:3.0:1788744412.034496:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034509:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744412.034512:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.034516:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034523:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccbb6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034542:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034549:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034554:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034559:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.034562:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034580:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034589:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac64354e400) 00010000:00010000:3.0:1788744412.034591:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.034594:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034600:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccbf5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034618:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034625:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.034630:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788744412.034771:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788744412.034845:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788744412.034866:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154518912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788744412.034935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744412.034990:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154518912 00000100:00100000:2.0:1788744412.034997:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154518912 00000100:00100000:2.0:1788744412.035050:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744412.035060:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154518912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788744412.035088:0:8432:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788744412.035120:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e12da, atime: 0x6a9e12da, ctime: 0x6a9e12da, blocks: 0x8 00010000:00010000:2.0:1788744412.035127:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035734:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.035739:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035747:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035758:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744412.035761:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.035765:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035781:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcccf8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035799:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035806:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035812:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035817:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.035820:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035827:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035844:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744412.035847:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.035850:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035855:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dccd1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035867:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035873:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035885:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035890:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.035893:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035898:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035906:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744412.035909:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.035912:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035917:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dccd61 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035930:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035936:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035941:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035946:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.035949:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035965:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035974:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:3.0:1788744412.035976:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744412.035980:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.035985:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dcce64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.036381:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788744412.036387:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:3.0:1788744412.036752:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744412.036886:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12370:x1875634138732288:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 8391us (8617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744412.036895:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00010000:00010000:2.0:1788744412.038199:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.038230:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.038242:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.038250:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.038273:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744412.038480:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875634154518912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3419us (3543us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788744412.038488:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744412.038526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154519040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788744412.038562:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788744412.038625:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac74394aa00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788744412.038632:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154518912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788744412.038649:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154519040 00000100:00100000:2.0:1788744412.038654:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154519040 00000100:00100000:2.0:1788744412.038697:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744412.038706:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154519040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788744412.038793:0:8966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788744412.038797:0:8966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788744412 00002000:00010000:2.0:1788744412.038800:0:8966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788744412.038808:0:8966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788744412 -> 1788744412 00002000:00010000:2.0:1788744412.038811:0:8966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788744412.038855:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154519040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (292us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788744412.038862:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788744412.038879:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788744412.038895:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac643e91500/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788744412.038900:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154519040:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788744412.043368:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744412.043383:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.052962:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744412.052971:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.052985:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.053012:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.053040:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac1126f6/0xb6207a6e76dcce8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.053065:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744412.053067:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744412.053070:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744412.053615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.053780:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138732416 00000100:00100000:3.0:1788744412.053790:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138732416 00000100:00100000:3.0:1788744412.053859:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788744412.053871:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2396:x1875634138732416:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788744412.056559:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788744412.056571:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788744412.060882:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138732416:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 7003us (7261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744412.060894:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1788744412.067570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.067663:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138732672 00000100:00100000:3.0:1788744412.067676:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138732672 00000100:00100000:3.0:1788744412.067756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:3.0:1788744412.067766:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12370:x1875634138732672:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744412.067827:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744412.067869:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcce79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6db expref: 19 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.067895:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:3.0:1788744412.067901:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744412.067939:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.067956:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.067989:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744412.068117:0:6516:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000962c1091 reply state 00000000ad90238f transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.068129:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.068148:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:3.0:1788744412.068151:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744412.068154:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744412.068256:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:12370:x1875634138732672:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 492us (696us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788744412.068263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:2.0:1788744412.080905:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.083798:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138732800 00000100:00100000:3.0:1788744412.083815:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138732800 00000100:00100000:2.0:1788744412.083944:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788744412.083957:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138732800:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788744412.084114:0:8966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788744412.084118:0:8966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788744412 -> 1788744412 00002000:00010000:2.0:1788744412.084121:0:8966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788744410 00002000:00010000:2.0:1788744412.084123:0:8966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788744412 -> 1788744412 00002000:00010000:2.0:1788744412.084126:0:8966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788744412.084213:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138732800:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 258us (3385us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788744412.084221:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1788744412.086619:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744412.086743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733056 00000100:00100000:1.0:1788744412.086753:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733056 00000100:00100000:1.0:1788744412.086809:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:1.0:1788744412.086829:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:12370:x1875634138733056:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788744412.086919:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.086935:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 20 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.086946:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.086979:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 20 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.086993:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 20 pid: 7792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.087008:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154519168:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744412.087085:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743227600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744412.097108:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744412.097156:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733184 00000100:00100000:1.0:1788744412.097167:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733184 00010000:00010000:1.0:1788744412.097210:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 21 pid: 7792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.097248:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1788744412.097259:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:2395:x1875634138733184:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744412.097296:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744412.097304:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 21 pid: 7792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.097325:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 21 pid: 7792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.097346:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:1.0:1788744412.097352:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.097360:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.097367:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.097388:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744412.098102:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:2395:x1875634138733184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 840us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744412.098113:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00010000:00010000:1.0:1788744412.099514:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcce5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6cd expref: 20 pid: 7792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.099537:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154519168:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744412.099559:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099569:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099575:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099643:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099651:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099659:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099665:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744412.099670:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099677:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099693:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:1.0:1788744412.099695:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788744412.099701:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.099706:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcce9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.099779:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12370:x1875634138733056:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 12960us (13167us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788744412.099787:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:1.0:1788744412.104177:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.104306:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733312 00000100:00100000:3.0:1788744412.104316:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733312 00000100:00100000:3.0:1788744412.104370:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1788744412.104380:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138733312:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788744412.104453:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.104474:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.104501:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744412.104505:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744412.104510:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.104542:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.104556:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.104570:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875634154519296:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744412.104766:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744412.108374:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744412.108421:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733440 00000100:00100000:2.0:1788744412.108430:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733440 00010000:00010000:2.0:1788744412.108468:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 9 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744412.108505:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:2.0:1788744412.108529:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138733440:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744412.108545:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744412.108567:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 9 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.108580:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 9 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.108604:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744412.108609:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744412.108615:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.108625:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.108645:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744412.108693:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138733440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 166us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744412.108700:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00010000:00010000:3.0:1788744412.110241:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de6180d/0xb6207a6e76dcce87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6e9 expref: 8 pid: 8431 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.110261:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875634154519296:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744412.110284:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110295:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110303:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110341:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110350:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110359:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110366:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744412.110371:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110380:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110396:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.110432:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61a7fab/0xb6207a6e76dccea3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.110509:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138733312:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 6129us (6340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744412.110518:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1788744412.113707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.113775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733696 00000100:00100000:3.0:1788744412.113784:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733696 00000100:00100000:3.0:1788744412.113850:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:3.0:1788744412.113861:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12370:x1875634138733696:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788744412.113937:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.113955:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.113965:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.113998:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.114012:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 19 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.114026:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875634154519424:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744412.114103:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744412.118914:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875634154519424:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744412.118961:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.120517:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.120633:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733824 00000100:00100000:3.0:1788744412.120729:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733824 00010000:00010000:3.0:1788744412.120769:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 20 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.120811:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1788744412.120820:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:2394:x1875634138733824:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744412.120858:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744412.120866:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 20 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.120878:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 20 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.120901:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcccf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d672 expref: 20 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.120917:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:3.0:1788744412.120923:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.120933:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.120941:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.120967:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744412.121017:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:2394:x1875634138733824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 198us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744412.121025:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00010000:00010000:3.0:1788744412.121052:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.121060:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.121650:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.121665:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.121673:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.121707:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.121719:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 19 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.121733:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875634154519552:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744412.121791:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744412.124912:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744412.125605:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138733952 00000100:00100000:1.0:1788744412.125615:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138733952 00010000:00010000:1.0:1788744412.125669:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 20 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.125709:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:1.0:1788744412.125719:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:2395:x1875634138733952:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744412.125732:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744412.125740:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 20 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.125753:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 20 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.125775:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:1.0:1788744412.125781:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.125791:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.125799:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.125818:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744412.125892:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:2395:x1875634138733952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 174us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744412.125900:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00010000:00010000:1.0:1788744412.125952:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcce6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6d4 expref: 19 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.125966:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875634154519552:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744412.125985:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.125993:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.126000:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744412.126108:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788744412.126237:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788744412.126274:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788744412.126345:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875634154519680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788744412.126394:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744412.126457:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac753225a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744412.126489:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154519680 00000100:00100000:1.0:1788744412.126494:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154519680 00000100:00100000:1.0:1788744412.126530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788744412.126538:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875634154519680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788744412.126609:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875634154519680:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744412.126616:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788744412.126747:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788744412.126752:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac643e91500, transno 4294967316 00000100:00100000:1.0:1788744412.126763:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875634154519680:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788744412.126875:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788744412.126914:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875634154519808:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788744412.126944:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744412.129288:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac753225b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744412.130293:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154519808 00000100:00100000:2.0:1788744412.130303:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154519808 00000100:00100000:2.0:1788744412.130356:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788744412.130366:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1875634154519808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788744412.131387:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1875634154519808:12345-0@lo:1000:mdt00_000.0 Request processed in 1018us (4438us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788744412.131672:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875634154519808:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788744412.131726:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131737:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131744:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131751:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437be200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744412.131756:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131764:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131779:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:1.0:1788744412.131783:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744412.131787:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131794:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcceb1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131825:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131831:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131853:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131858:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744412.131861:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131867:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131875:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:1.0:1788744412.131878:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744412.131880:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131887:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccde6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131909:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131924:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131933:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131972:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.131988:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 22 pid: 6517 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.132002:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875634154519936:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744412.132078:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7482eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744412.132722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788744412.136760:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875634154519936:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744412.136791:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.137846:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744412.137926:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138734080 00000100:00100000:2.0:1788744412.137934:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138734080 00010000:00010000:2.0:1788744412.137969:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 23 pid: 6517 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744412.138497:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:2.0:1788744412.138508:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:2395:x1875634138734080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744412.138524:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744412.138532:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 23 pid: 6517 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.138546:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 23 pid: 6517 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.138567:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcce02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6b8 expref: 23 pid: 6517 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.138582:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744412.138587:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.138596:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.138618:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.138652:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744412.138711:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:2395:x1875634138734080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 204us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744412.138719:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00010000:00010000:2.0:1788744412.141759:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141776:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141792:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141798:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141805:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141812:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744412.141816:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141823:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141850:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744412.141853:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744412.141871:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141878:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcceb8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141893:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141899:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141905:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141910:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfa00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744412.141914:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141920:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141928:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac64354e500) 00010000:00010000:2.0:1788744412.141930:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744412.141933:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.141938:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcceaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744412.142224:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12370:x1875634138733696:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 28361us (28522us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788744412.142234:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 200 00000020:00080000:2.0:1788744412.142247:0:6515:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788744412.146967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.147019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138734336 00000040:00080000:0.0:1788744412.147023:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:3.0:1788744412.147029:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138734336 00000040:00080000:0.0:1788744412.147030:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788744412.147077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788744412.147087:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750210050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12370:x1875634138734336:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1788744412.147768:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788744412.147780:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1788744412.148028:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788744412.148060:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788744412.148095:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.148121:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.148134:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.148218:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.148225:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.148230:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.148252:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788744412.148350:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750210050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:12370:x1875634138734336:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1260us (1387us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788744412.148360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000020:00080000:3.0:1788744412.148366:0:6518:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788744412.148738:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744412.148746:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.148753:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744412.148757:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.148766:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.148780:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:1.0:1788744412.148784:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788744412.148788:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.148794:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccebf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.148806:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744412.148808:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744412.148816:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744412.416622:0:14651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744412.416633:0:14651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744412.416664:0:14651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788744412.416670:0:14651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788744412.526547:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744412.570147:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.570215:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138734592 00000100:00100000:3.0:1788744412.570225:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138734592 00000100:00100000:3.0:1788744412.570283:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:3.0:1788744412.570293:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:12381:x1875634138734592:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744412.570315:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744412.570339:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6f0 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.570594:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccecd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.570610:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccecd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.570622:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccecd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744412.570736:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788744412.570852:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f0 expref: 26 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.570868:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccecd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f0 expref: 25 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.570876:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744412.570880:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744412.570883:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be400, rc 0) 00000100:00100000:3.0:1788744412.570984:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:12381:x1875634138734592:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 692us (846us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788744412.570992:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:0.0:1788744412.576205:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.576303:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138734720 00000100:00100000:3.0:1788744412.576315:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138734720 00000100:00100000:3.0:1788744412.576502:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:3.0:1788744412.576515:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:12381:x1875634138734720:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788744412.576605:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576622:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576646:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576663:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576670:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576676:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576751:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576759:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576766:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744412.576807:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576820:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576847:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576854:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576860:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.576864:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576871:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576883:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744412.576885:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.576890:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576896:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccedb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576906:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576912:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576917:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576923:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfe00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.576931:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576938:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576946:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac74505ff00) 00010000:00010000:3.0:1788744412.576949:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.576952:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576958:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccee2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576973:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576979:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576985:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.576991:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.576994:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.577000:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.577006:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac74505fa00) 00010000:00010000:3.0:1788744412.577008:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.577018:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.577024:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.577100:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:12381:x1875634138734720:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 587us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744412.577107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:0.0:1788744412.644513:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744412.644618:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138734976 00000100:00100000:2.0:1788744412.644627:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138734976 00000100:00100000:2.0:1788744412.644691:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:2.0:1788744412.644702:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+25:12384:x1875634138734976:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744412.644725:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744412.644745:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccef0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.644821:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.644846:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.644858:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.644874:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.644882:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.644888:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645061:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645070:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645096:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744412.645106:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788744412.645318:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645326:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645331:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645337:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744412.645340:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645347:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645358:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744412.645362:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744412.645366:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645373:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dccef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645386:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.645392:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.646258:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.646265:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744412.646269:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.646277:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.646288:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020ce00) 00010000:00010000:2.0:1788744412.646291:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744412.646294:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.646301:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccefe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.650011:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dccef0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.650044:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.650054:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744412.650057:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744412.650060:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58c00, rc 0) 00000100:00100000:3.0:1788744412.650251:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12384:x1875634138734976:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 5548us (5745us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788744412.650260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:0.0:1788744412.660233:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.660364:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138735104 00000100:00100000:3.0:1788744412.660375:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138735104 00000100:00100000:3.0:1788744412.660521:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:3.0:1788744412.660533:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12384:x1875634138735104:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788744412.660601:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660619:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660647:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660687:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660695:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660703:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660709:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.660713:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660721:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660733:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744412.660736:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744412.660742:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.660748:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.661790:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12384:x1875634138735104:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 1239us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744412.661802:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:0.0:1788744412.672304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744412.672572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138735360 00000100:00100000:2.0:1788744412.672584:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138735360 00000100:00100000:2.0:1788744412.672650:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1788744412.672662:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12384:x1875634138735360:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744412.672942:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+28:12384:x1875634138735360:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 281us (650us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788744412.672951:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788744412.712198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.714174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138735616 00000100:00100000:3.0:1788744412.718621:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138735616 00000100:00100000:3.0:1788744412.718691:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:3.0:1788744412.718702:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+28:11915:x1875634138735616:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788744412.718729:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744412.718749:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf1a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d6fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.718882:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.718897:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.718906:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.718940:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.718954:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 29 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.718967:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154520064:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744412.719148:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744412.723864:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.723990:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154520064:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744412.724018:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.724159:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138735744 00000100:00100000:1.0:1788744412.724167:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138735744 00010000:00010000:1.0:1788744412.724213:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 30 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744412.724260:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:1.0:1788744412.724271:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:2395:x1875634138735744:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744412.724286:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744412.724293:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 30 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.724306:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 30 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.724329:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f7 expref: 30 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.724345:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:1.0:1788744412.724350:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.724359:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.724367:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.724475:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744412.724538:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:2395:x1875634138735744:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 268us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744412.724546:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00010000:00010000:3.0:1788744412.727577:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.727616:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744412.728286:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788744412.728850:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf1a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.728873:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.728882:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744412.728884:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744412.728887:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfe00, rc 0) 00000100:00100000:3.0:1788744412.729001:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:11915:x1875634138735616:12345-192.168.203.4@tcp:101:bash.0 Request processed in 10299us (16874us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788744412.729010:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:0.0:1788744412.747913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744412.747955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138735872 00000100:00100000:0.0:1788744412.747966:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138735872 00000100:00100000:0.0:1788744412.748016:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:0.0:1788744412.748026:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:11915:x1875634138735872:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744412.748051:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744412.748072:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccf2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.748152:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccf36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.748168:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccf36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.749559:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccf36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.750926:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dccf2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d705 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.750955:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccf36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d705 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744412.750965:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:0.0:1788744412.750968:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744412.750972:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dacc00, rc 0) 00000100:00100000:0.0:1788744412.751048:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11915:x1875634138735872:12345-192.168.203.4@tcp:101:bash.0 Request processed in 3021us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744412.751070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:2.0:1788744412.760152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.760952:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138736128 00000100:00100000:3.0:1788744412.760963:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138736128 00000100:00100000:3.0:1788744412.761032:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:3.0:1788744412.761043:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:11915:x1875634138736128:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:3.0:1788744412.761500:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.761518:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.761530:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744412.761590:0:7792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788744412.761613:0:7792:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b6e8136c reply state 00000000e638d815 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.761626:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.762266:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744412.762269:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788744412.762273:0:7792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788744412.762361:0:7792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788744412.763859:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:11915:x1875634138736128:12345-192.168.203.4@tcp:36:bash.0 Request processed in 2809us (3710us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788744412.763885:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 207 00000020:00080000:2.0:1788744412.763892:0:7792:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788744412.771777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744412.771948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138736256 00000100:00100000:1.0:1788744412.771959:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138736256 00000100:00100000:1.0:1788744412.772019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:1.0:1788744412.772031:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+34:11915:x1875634138736256:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788744412.772056:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744412.772076:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccf44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d70c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.772148:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccf44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d70c expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.772164:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccf44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d70c expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744412.772357:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:1.0:1788744412.772362:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744412.772367:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535e00, rc 0) 00000100:00100000:1.0:1788744412.772451:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:11915:x1875634138736256:12345-192.168.203.4@tcp:101:bash.0 Request processed in 422us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744412.772459:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:0.0:1788744412.785711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744412.785856:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138736384 00000100:00100000:2.0:1788744412.785866:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138736384 00000100:00100000:2.0:1788744412.785923:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1788744412.785934:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:11915:x1875634138736384:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744412.785952:0:8966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744412.785972:0:8966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d713 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744412.785999:0:8966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e12dc, atime: 0x6a9e12da, ctime: 0x6a9e12dc, blocks: 0x8 00010000:00010000:2.0:1788744412.786021:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788744412.786026:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744412.786043:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 8 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.786060:0:8966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 8 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.786074:0:8966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744412.786134:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:11915:x1875634138736384:12345-192.168.203.4@tcp:101:bash.0 Request processed in 200us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744412.786141:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1788744412.798486:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.798580:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138736512 00000100:00100000:3.0:1788744412.798593:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138736512 00002000:00010000:3.0:1788744412.798632:0:8436:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788744412.798637:0:8436:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac6445b0380 with x1875634138736512 ext(0->18446744073709551615) 00002000:00010000:3.0:1788744412.798654:0:8436:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac6445b0380. 00000100:00100000:3.0:1788744412.798921:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788744412.798932:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138736512:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:3.0:1788744412.799164:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788744412.799167:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788744412 -> 1788744413 00002000:00010000:3.0:1788744412.799170:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788744410 -> 1788744410 00002000:00010000:3.0:1788744412.799173:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788744412 -> 1788744413 00002000:00010000:3.0:1788744412.799175:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788744412.799240:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138736512:12345-192.168.203.4@tcp:10:bash.0 Request processed in 308us (764us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788744412.799388:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00002000:00010000:3.0:1788744412.799393:0:8436:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788744412.799497:0:8436:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac6445b0380 with x1875634138736512 ext(0->18446744073709551615) 00002000:00010000:3.0:1788744412.799504:0:8436:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac6445b0380. 00000100:00100000:0.0:1788744412.952470:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744412.952808:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138736640 00000100:00100000:3.0:1788744412.952890:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138736640 00000100:00100000:3.0:1788744412.952955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:3.0:1788744412.952965:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:12398:x1875634138736640:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788744412.953390:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953436:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953449:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953464:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953471:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953478:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953560:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953569:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953576:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744412.953641:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953653:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953659:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953665:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953670:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.953674:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953681:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953693:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744412.953696:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.953701:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953707:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953720:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953726:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953738:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953744:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.953746:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953752:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953758:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac74505fa00) 00010000:00010000:3.0:1788744412.953760:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.953763:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953768:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953795:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953801:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953806:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953811:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744412.953813:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953838:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953847:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744412.953850:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744412.953853:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744412.953859:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744412.954912:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:12398:x1875634138736640:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1944us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744412.954922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:0.0:1788744413.010320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.010514:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138736896 00000100:00100000:2.0:1788744413.010526:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138736896 00000100:00080000:3.0:1788744413.011269:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744413.012313:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:2.0:1788744413.012343:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+35:12401:x1875634138736896:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744413.012365:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744413.012386:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccf67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d71a expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012481:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012497:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012508:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012523:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012529:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012535:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012651:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012661:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012669:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744413.012697:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744413.012777:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012785:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012792:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012798:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744413.012802:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012810:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012821:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744413.012825:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744413.012838:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012845:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dccf6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012858:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012865:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012881:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012887:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744413.012890:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012896:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012904:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:2.0:1788744413.012906:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744413.012909:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012914:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dccf75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012956:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dccf67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d71a expref: 38 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012970:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d71a expref: 37 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.012977:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744413.012979:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744413.012982:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58c00, rc 0) 00000100:00100000:2.0:1788744413.013123:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:12401:x1875634138736896:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 793us (2811us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788744413.013138:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:2.0:1788744413.017777:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.017866:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138737024 00000100:00100000:1.0:1788744413.017876:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138737024 00000100:00100000:1.0:1788744413.017971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:1.0:1788744413.017988:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:12401:x1875634138737024:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1788744413.018060:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.018076:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.018085:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.018119:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.018132:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 37 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744413.018145:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154520192:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744413.018235:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7433ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744413.021160:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875634154520192:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744413.021188:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.025105:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.025462:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138737280 00000100:00100000:0.0:1788744413.025472:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138737280 00000100:00100000:0.0:1788744413.025529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788744413.025539:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:6162:x1875634138737280:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788744413.026067:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:6162:x1875634138737280:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 527us (968us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788744413.026076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1788744413.028966:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.029163:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138737408 00000100:00100000:2.0:1788744413.029173:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138737408 00010000:00010000:2.0:1788744413.029211:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 39 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.029250:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1788744413.029258:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:2395:x1875634138737408:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744413.029272:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744413.029278:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 39 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.029290:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 39 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.029311:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfe00/0xb6207a6e76dccf21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6fe expref: 39 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.029327:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744413.029332:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.029341:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.029350:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.029447:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744413.029491:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:2395:x1875634138737408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 234us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744413.029499:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00010000:00010000:1.0:1788744413.029939:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.029947:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.029995:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.030002:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.030019:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.030026:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744413.030030:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.030037:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.030046:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:1.0:1788744413.030049:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744413.030052:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.030058:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccf8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744413.030109:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:12401:x1875634138737024:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 12122us (12340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.030116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:1.0:1788744413.033294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.033384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138737664 00000100:00100000:3.0:1788744413.033440:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138737664 00000100:00100000:3.0:1788744413.033485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1788744413.033494:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+37:12401:x1875634138737664:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788744413.033712:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:12401:x1875634138737664:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 217us (424us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788744413.033719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:0.0:1788744413.038906:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154520320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744413.039046:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744413.039127:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154520320 00000100:00100000:1.0:1788744413.039136:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154520320 00000100:00100000:1.0:1788744413.039194:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788744413.039203:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154520320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744413.039237:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788744413.039709:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154520320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 506us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.039734:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788744413.039819:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154520320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744413.137751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.137958:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138737920 00000100:00100000:3.0:1788744413.138057:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138737920 00000100:00100000:3.0:1788744413.138117:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:3.0:1788744413.138128:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+38:12412:x1875634138737920:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:3.0:1788744413.138153:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744413.138173:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.138241:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.138256:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.138267:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.138281:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.138288:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.138294:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139076:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dccfa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139090:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dccfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139098:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dccfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744413.139119:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788744413.139197:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139205:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139212:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139219:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744413.139223:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139230:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139242:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744413.139245:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744413.139249:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139255:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dccf98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.139268:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.140133:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.140157:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.140163:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744413.140167:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.142927:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.142950:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac74505fa00) 00010000:00010000:3.0:1788744413.142953:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744413.142959:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.142967:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dccf9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.143046:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dccf91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d721 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.143063:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dccfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d721 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.143070:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744413.143073:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744413.143075:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be200, rc 0) 00000100:00100000:3.0:1788744413.143165:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+40:12412:x1875634138737920:12345-192.168.203.4@tcp:101:cat.0 Request processed in 5037us (5422us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788744413.143192:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:2.0:1788744413.150670:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.150768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138738176 00000100:00100000:3.0:1788744413.150777:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138738176 00000100:00100000:3.0:1788744413.150848:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:3.0:1788744413.150860:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+40:12412:x1875634138738176:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:3.0:1788744413.151152:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+41:12412:x1875634138738176:12345-192.168.203.4@tcp:35:cat.0 Request processed in 293us (490us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788744413.151159:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:0.0:1788744413.186024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.186139:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138738432 00000100:00100000:2.0:1788744413.186152:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138738432 00000100:00100000:2.0:1788744413.186217:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:2.0:1788744413.186227:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+41:12413:x1875634138738432:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:2.0:1788744413.186283:0:7792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788744413.186310:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccf44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d70c expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186334:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dccfa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d721 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186347:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dccf7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d71a expref: 39 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186371:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dccf36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d705 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186385:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744413.186391:0:7792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744413.186458:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186484:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186494:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186509:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186516:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186523:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186604:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186612:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186618:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744413.186824:0:7792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788744413.186846:0:7792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394868443836ns, next at 395868440688ns, rc = 0 00010000:00010000:2.0:1788744413.186888:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186897:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186914:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186922:0:7792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186929:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186935:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186959:0:7792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744413.186977:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186985:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186992:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.186998:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744413.187001:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744413.187002:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.187011:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187015:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.187028:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744413.187035:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187035:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744413.187041:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788744413.187333:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187342:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dccfc2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187429:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187437:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187443:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187449:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744413.187452:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187458:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187467:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744413.187469:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744413.187473:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187478:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dccfb4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744413.187489:0:7792:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c8ed7a73 reply state 00000000c03ab8ef transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187512:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.187518:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:2.0:1788744413.187521:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744413.187523:0:7792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744413.187614:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:12413:x1875634138738432:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1386us (1599us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788744413.187622:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 213 00010000:00010000:3.0:1788744413.189032:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.189053:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:3.0:1788744413.189057:0:9528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744413.189062:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.189069:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dccfc9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.189084:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744413.189086:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744413.189099:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744413.238503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.238670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138738688 00000100:00100000:1.0:1788744413.238680:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138738688 00000100:00100000:1.0:1788744413.238756:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:1.0:1788744413.238767:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+39:12419:x1875634138738688:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788744413.238792:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744413.238817:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccfd0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.238937:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.238952:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.238965:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.238989:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.238996:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239002:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744413.239350:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788744413.239542:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239568:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239576:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239608:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239614:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239621:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239627:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744413.239631:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239639:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239649:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744413.239652:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744413.239657:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239663:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dccfd7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744413.239675:0:6517:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000bd7300cd reply state 00000000f9f2d8ac transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239691:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239697:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:1.0:1788744413.239700:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744413.239702:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788744413.239749:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dccfd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239763:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.239770:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744413.239772:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744413.239775:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535e00, rc 0) 00000100:00100000:1.0:1788744413.239858:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12419:x1875634138738688:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1092us (1365us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788744413.239867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:0.0:1788744413.243392:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.243534:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138738816 00000100:00100000:3.0:1788744413.243544:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138738816 00000100:00100000:3.0:1788744413.243611:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:3.0:1788744413.243624:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138738816:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788744413.243645:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744413.243668:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d72f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744413.243695:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744413.243717:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788744413.243723:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744413.243735:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.243754:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.243768:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bee00, rc 0) 00000100:00100000:3.0:1788744413.243839:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138738816:12345-192.168.203.4@tcp:101:bash.0 Request processed in 218us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.243846:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00080000:2.0:1788744413.244007:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744413.247618:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.247759:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138738944 00000100:00100000:3.0:1788744413.247770:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138738944 00000100:00100000:3.0:1788744413.247846:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1788744413.247857:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:12419:x1875634138738944:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788744413.247877:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744413.247910:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d736 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.247946:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.247963:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744413.247969:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744413.248042:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.248079:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.248092:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.248107:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875634154520448:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744413.248312:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744413.251610:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875634154520448:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744413.251659:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.251680:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf400, rc 0) 00000100:00100000:3.0:1788744413.251790:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:12419:x1875634138738944:12345-192.168.203.4@tcp:101:bash.0 Request processed in 3934us (4180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.251815:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1788744413.255055:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.255259:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138739072 00000100:00100000:2.0:1788744413.255269:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138739072 00010000:00010000:2.0:1788744413.255313:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.255665:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:2.0:1788744413.255676:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138739072:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744413.255691:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744413.255711:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.255725:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.255762:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e067d7/0xb6207a6e76dccff3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d72f expref: 9 pid: 8432 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.255778:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744413.255782:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744413.255789:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.255798:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.255844:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.255858:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6445b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1875634154520576:192.168.203.4@tcp:105: 00000100:00100000:2.0:1788744413.255935:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744413.259687:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6445b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1875634154520576:192.168.203.4@tcp:105: 00010000:00010000:3.0:1788744413.259714:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744413.259771:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138739072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4096us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.259781:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:0.0:1788744413.262054:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.262156:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138739328 00000100:00100000:3.0:1788744413.262166:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138739328 00000100:00100000:3.0:1788744413.262336:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788744413.262346:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+42:12419:x1875634138739328:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:3.0:1788744413.263342:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:12419:x1875634138739328:12345-192.168.203.4@tcp:35:bash.0 Request processed in 994us (1292us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788744413.263361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:0.0:1788744413.456310:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.456399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138739456 00000100:00100000:3.0:1788744413.456445:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138739456 00000100:00100000:3.0:1788744413.456496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:3.0:1788744413.456507:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+43:12435:x1875634138739456:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744413.456530:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744413.456551:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d73d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.456617:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd008 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.456632:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.456664:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744413.456832:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788744413.456837:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744413.456858:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.456883:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d73d expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.456901:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d73d expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.456909:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:3.0:1788744413.456912:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744413.456916:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfa00, rc 0) 00000100:00100000:3.0:1788744413.457015:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+44:12435:x1875634138739456:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 509us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.457023:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:2.0:1788744413.475471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.475641:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138739712 00000100:00100000:0.0:1788744413.475650:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138739712 00000100:00100000:0.0:1788744413.475708:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:0.0:1788744413.475720:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+44:12435:x1875634138739712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744413.475749:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.475782:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd00f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d744 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.475907:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.475922:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.475934:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744413.475946:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788744413.476053:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd00f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d744 expref: 47 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.476072:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd016 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d744 expref: 46 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.476080:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:0.0:1788744413.476084:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744413.476087:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dace00, rc 0) 00000100:00100000:0.0:1788744413.476738:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+46:12435:x1875634138739712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1010us (1267us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788744413.476747:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:0.0:1788744413.483788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.483847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.483998:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740096 00000100:00100000:2.0:1788744413.484008:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740096 00000100:00100000:2.0:1788744413.484077:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788744413.484087:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+46:2394:x1875634138740096:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744413.484103:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744413.484137:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd016 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d744 expref: 46 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.484168:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744413.484174:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744413.484232:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+45:2394:x1875634138740096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744413.484239:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788744413.484457:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138739968 00000100:00100000:1.0:1788744413.484462:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138739968 00000100:00100000:1.0:1788744413.484501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:1.0:1788744413.484508:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+45:12435:x1875634138739968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744413.484529:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744413.484544:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd024 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d74b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.484640:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd02b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.484663:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd02b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.484674:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd02b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744413.484689:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788744413.484807:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd024 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d74b expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.484836:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd02b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d74b expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.484844:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:1.0:1788744413.484847:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744413.484850:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535200, rc 0) 00000100:00100000:1.0:1788744413.484885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:12435:x1875634138739968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 377us (1108us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788744413.484891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:2.0:1788744413.493536:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.493731:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740224 00000100:00100000:3.0:1788744413.493742:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740224 00000100:00100000:3.0:1788744413.493796:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1788744413.493807:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2397:x1875634138740224:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1788744413.493862:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.493882:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.493905:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788744413.493910:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744413.493915:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.493949:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.493963:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 8 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.494093:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875634154520704:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744413.494253:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744413.501756:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875634154520704:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744413.501787:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.506995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.512127:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740352 00000100:00100000:0.0:1788744413.512148:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740352 00002000:00100000:2.0:1788744413.515644:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ac6445b0e00 x1875634138740352/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:689/0 lens 504/0 e 0 to 0 dl 1788744424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744413.515660:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac6445b0e00 with x1875634138740352 ext(0->8) 00010000:00010000:2.0:1788744413.515672:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 9 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.515689:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 9 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744413.515698:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac6445b0e00 00000100:00100000:1.0:1788744413.515978:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788744413.515992:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2395:x1875634138740352:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:1.0:1788744413.519057:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:2395:x1875634138740352:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 3060us (12061us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788744413.519072:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:1.0:1788744413.519085:0:8437:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ac6445b0e00 x1875634138740352/t4294967309(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:689/0 lens 504/448 e 0 to 0 dl 1788744424 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744413.519114:0:8437:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac6445b0e00 with x1875634138740352 ext(0->8) 00010000:00010000:1.0:1788744413.519124:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.519145:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744413.519154:0:8437:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ac6445b0e00 00000100:00100000:0.0:1788744413.525543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.526311:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740480 00000100:00100000:3.0:1788744413.526324:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740480 00010000:00010000:3.0:1788744413.526371:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.526447:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:3.0:1788744413.526456:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:2396:x1875634138740480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744413.526479:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788744413.526497:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788744413.526499:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788744414 00002000:00010000:3.0:1788744413.526502:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788744414 00002000:00010000:3.0:1788744413.526504:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788744414 00002000:00010000:3.0:1788744413.526506:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788744413.526513:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.526527:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.526551:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c37af8a5/0xb6207a6e76dccffa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d736 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.526568:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744413.526572:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744413.526578:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.526588:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.526625:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744413.526684:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2396:x1875634138740480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 228us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.526692:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00010000:00010000:0.0:1788744413.526948:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.526959:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.526980:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.526989:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.526997:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.527003:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744413.527007:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.527016:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.527028:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.527036:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de6180d/0xb6207a6e76dcd039 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.527095:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2397:x1875634138740224:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 33288us (33566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.527103:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:1.0:1788744413.531454:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.531573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740736 00000100:00100000:0.0:1788744413.531584:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740736 00000100:00100000:0.0:1788744413.531654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1788744413.531666:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+47:12435:x1875634138740736:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:0.0:1788744413.531895:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd02b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d74b expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744413.532116:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788744413.532152:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788744413.532470:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788744413.532506:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.532522:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 51 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.532531:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.532564:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 51 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.532578:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 51 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.532606:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875634154520832:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744413.540142:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744413.544058:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.544240:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740864 00000100:00100000:3.0:1788744413.544250:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740864 00010000:00010000:3.0:1788744413.544287:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 52 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.544325:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:3.0:1788744413.544335:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+52:2394:x1875634138740864:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744413.544351:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744413.544369:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 52 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.544382:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 52 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.544654:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:3.0:1788744413.544661:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.544671:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.544679:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.544700:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744413.544866:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dccfe5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d728 expref: 52 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744413.544883:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875634154520832:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744413.544904:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.544912:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.544918:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744413.545063:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788744413.545192:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788744413.545281:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875634154520960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744413.545332:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744413.545469:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75569e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744413.546208:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+53:2394:x1875634138740864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1863us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.546220:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1788744413.548282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154520960 00000100:00100000:0.0:1788744413.548298:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154520960 00000100:00100000:0.0:1788744413.550302:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788744413.550325:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875634154520960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788744413.550479:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875634154520960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.550487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788744413.550592:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875634154520960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788744413.550765:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788744413.550850:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6445b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875634154521088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744413.550890:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744413.553277:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744413.553347:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154521088 00000100:00100000:1.0:1788744413.553357:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154521088 00000100:00100000:0.0:1788744413.554089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788744413.554104:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875634154521088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788744413.555610:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6519:x1875634154521088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1506us (4714us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788744413.555624:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788744413.556110:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6445b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875634154521088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788744413.556265:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788744413.556310:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.556322:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.556330:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.556336:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744413.556340:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.556348:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.556360:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744413.556364:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788744413.556368:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.556374:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd040 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744413.556500:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788744413.556556:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788744413.556568:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395238165142ns, next at 396238162804ns, rc = 0 00000001:00080000:2.0:1788744413.556574:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788744413.556596:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac64354d300) 00010000:00010000:2.0:1788744413.556600:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788744413.556613:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd02b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d74b expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.556762:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:12435:x1875634138740736:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 25097us (25317us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788744413.556772:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000020:00080000:2.0:1788744413.556776:0:6519:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:2.0:1788744413.560038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744413.560458:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.560530:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138740992 00000100:00100000:0.0:1788744413.560544:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138740992 00000100:00100000:0.0:1788744413.560598:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:0.0:1788744413.560608:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+54:12435:x1875634138740992:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744413.560630:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.560650:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd047 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d752 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.560701:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd047 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d752 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.560735:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd047 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d752 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.560758:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.560761:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744413.560765:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dadc00, rc 0) 00000100:00100000:0.0:1788744413.560833:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:12435:x1875634138740992:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 217us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.560840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:1.0:1788744413.567368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.567571:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138741248 00000100:00100000:3.0:1788744413.567596:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138741248 00000100:00100000:3.0:1788744413.567656:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1788744413.567665:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+55:12435:x1875634138741248:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788744413.568057:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12435:x1875634138741248:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 391us (695us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788744413.568066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1788744413.654714:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.654878:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138741376 00000100:00100000:0.0:1788744413.654902:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138741376 00000100:00100000:0.0:1788744413.654980:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:0.0:1788744413.654991:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12445:x1875634138741376:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1788744413.655076:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655097:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655109:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655119:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655136:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655163:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655268:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655276:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655282:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744413.655327:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655340:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655346:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655354:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655360:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744413.655364:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655372:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655391:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:0.0:1788744413.655453:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744413.655459:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655467:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd04e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655483:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655490:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655497:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655503:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744413.655505:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655512:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655520:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:0.0:1788744413.655522:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744413.655524:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655529:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd055 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655538:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655549:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655555:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655559:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744413.655561:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655566:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655573:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.655575:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744413.655577:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.655582:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd05c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.656305:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12445:x1875634138741376:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1311us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.656315:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:0.0:1788744413.701836:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.701978:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138741632 00000100:00100000:2.0:1788744413.701988:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138741632 00000100:00100000:2.0:1788744413.702051:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:2.0:1788744413.702063:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+56:12448:x1875634138741632:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788744413.702084:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744413.702107:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd063 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d759 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702291:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702309:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702319:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702331:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702351:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702358:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702787:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702796:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702803:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744413.702813:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788744413.702925:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702933:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702941:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702947:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744413.702951:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702958:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702982:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744413.702986:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744413.702990:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.702996:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd06a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703010:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703016:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703022:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703028:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744413.703031:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703036:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703043:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:2.0:1788744413.703045:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744413.703048:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703053:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd071 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703101:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd063 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 59 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703114:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 58 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.703122:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744413.703125:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744413.703835:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59200, rc 0) 00000100:00100000:2.0:1788744413.703917:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12448:x1875634138741632:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1855us (2099us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788744413.703926:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:1.0:1788744413.707945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.708034:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138741760 00000100:00100000:3.0:1788744413.708046:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138741760 00000100:00100000:3.0:1788744413.708103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:3.0:1788744413.708115:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12448:x1875634138741760:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788744413.708194:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708212:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708224:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708262:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708269:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708275:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708280:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744413.708284:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708306:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708317:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744413.708320:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744413.708325:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.708331:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd086 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.708597:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12448:x1875634138741760:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 484us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.708606:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:1.0:1788744413.711787:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.712228:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138742016 00000100:00100000:2.0:1788744413.712239:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138742016 00000100:00100000:2.0:1788744413.712301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788744413.712313:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+58:12448:x1875634138742016:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788744413.712598:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:12448:x1875634138742016:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 287us (821us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788744413.712607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1788744413.778012:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.778119:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138742272 00000100:00100000:2.0:1788744413.778143:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138742272 00000100:00100000:2.0:1788744413.778203:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:2.0:1788744413.778213:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:12458:x1875634138742272:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788744413.778238:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744413.778241:0:7792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744413.778281:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd008 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d73d expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.778300:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744413.778304:0:7792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744413.778317:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd08d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d760 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.778478:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.778493:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 59 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.778502:0:7792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.778533:0:7792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 59 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.778548:0:7792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 59 pid: 10509 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.778561:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6445b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521216:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744413.778655:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744413.781152:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744413.781249:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6445b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521216:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744413.781277:0:7792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.781354:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138742400 00000100:00100000:3.0:1788744413.781362:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138742400 00010000:00010000:3.0:1788744413.781393:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 60 pid: 10509 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.781895:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:3.0:1788744413.781906:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:2395:x1875634138742400:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744413.781936:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744413.781944:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 60 pid: 10509 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.781955:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 60 pid: 10509 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.781989:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59200/0xb6207a6e76dcd078 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d759 expref: 60 pid: 10509 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.782003:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744413.782007:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.782016:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.782023:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.782044:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744413.782217:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:2395:x1875634138742400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 313us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744413.782225:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00010000:00010000:0.0:1788744413.782448:0:7792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.782457:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744413.782485:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788744413.782608:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd08d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 60 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.782634:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 59 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.782641:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.782644:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744413.782646:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58a00, rc 0) 00000100:00100000:0.0:1788744413.782673:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:12458:x1875634138742272:12345-192.168.203.4@tcp:101:bash.0 Request processed in 4462us (4671us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788744413.782680:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:2.0:1788744413.788016:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.788105:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138742528 00000100:00100000:0.0:1788744413.788116:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138742528 00000100:00100000:0.0:1788744413.788205:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:0.0:1788744413.788215:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+59:12458:x1875634138742528:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744413.788238:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.788258:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd0a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d767 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.788292:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.788305:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.788334:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.788477:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd0a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 61 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.788497:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 60 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.788505:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.788508:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744413.788511:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad800, rc 0) 00000100:00100000:0.0:1788744413.788570:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:12458:x1875634138742528:12345-192.168.203.4@tcp:101:bash.0 Request processed in 356us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.788577:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:1.0:1788744413.792130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.792218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138742784 00000100:00100000:0.0:1788744413.792227:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138742784 00000100:00100000:0.0:1788744413.792305:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:0.0:1788744413.792316:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+60:12458:x1875634138742784:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:0.0:1788744413.792574:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.792592:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.792604:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744413.792795:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788744413.792819:0:6516:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000042657948 reply state 000000000799e2f2 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.792842:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.792850:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.792853:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744413.792857:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744413.793011:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12458:x1875634138742784:12345-192.168.203.4@tcp:36:bash.0 Request processed in 695us (887us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788744413.793019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 224 00000020:00080000:0.0:1788744413.793023:0:6516:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788744413.795351:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.795554:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138742912 00000100:00100000:0.0:1788744413.795564:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138742912 00000100:00100000:0.0:1788744413.795619:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:0.0:1788744413.795639:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12458:x1875634138742912:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744413.795660:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.795679:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd0b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d76e expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.795766:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.795780:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 64 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.795789:0:7792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.795845:0:7792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 64 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.795859:0:7792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 64 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.795873:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521344:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744413.795943:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744413.800002:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.800085:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138743040 00000100:00100000:1.0:1788744413.800095:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138743040 00010000:00010000:1.0:1788744413.800132:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 65 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744413.800171:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:1.0:1788744413.800180:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:2394:x1875634138743040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744413.800195:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744413.800202:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 65 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.800213:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 65 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.800233:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744413.800238:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.800248:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.800272:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.800290:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744413.800348:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:2394:x1875634138743040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 168us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.800356:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00010000:00010000:0.0:1788744413.801865:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd094 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d760 expref: 64 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.801888:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521344:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744413.801909:0:7792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.801917:0:7792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.801922:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744413.801977:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788744413.801981:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744413.802000:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.802034:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd0b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 64 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.802073:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 63 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.802082:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.802085:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744413.802088:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dace00, rc 0) 00000100:00100000:0.0:1788744413.802151:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12458:x1875634138742912:12345-192.168.203.4@tcp:101:bash.0 Request processed in 6523us (6808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.802159:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:2.0:1788744413.806749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.806851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138743296 00000100:00100000:1.0:1788744413.806861:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138743296 00000100:00100000:1.0:1788744413.806919:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:1.0:1788744413.806929:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+63:12458:x1875634138743296:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788744413.807153:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12458:x1875634138743296:12345-192.168.203.4@tcp:35:bash.0 Request processed in 225us (414us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788744413.807161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:1.0:1788744413.882515:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.882606:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138743424 00000100:00100000:0.0:1788744413.882616:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138743424 00000100:00100000:0.0:1788744413.882692:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:0.0:1788744413.882703:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+64:12464:x1875634138743424:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744413.882730:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.882751:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd0c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d775 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.882819:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd0cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.882845:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.882856:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744413.882898:0:10509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788744413.882916:0:10509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744413.882938:0:10509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.882962:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd0c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d775 expref: 66 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.882980:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd0cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d775 expref: 65 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.882989:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:0.0:1788744413.882992:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744413.882995:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac200, rc 0) 00000100:00100000:0.0:1788744413.883105:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12464:x1875634138743424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 403us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.883112:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:0.0:1788744413.889102:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.889735:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138743552 00000100:00100000:1.0:1788744413.889747:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138743552 00000100:00100000:1.0:1788744413.889856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:1.0:1788744413.889867:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12464:x1875634138743552:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744413.889887:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744413.889909:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd0d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d77c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.889981:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.889995:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890022:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890034:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890041:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890048:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890120:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890141:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890288:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744413.890330:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788744413.890335:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744413.890365:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890377:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890387:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890433:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890440:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890446:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744413.890450:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890457:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890468:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744413.890472:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744413.890477:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890483:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534a00/0xb6207a6e76dcd0da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890498:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890504:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890510:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890515:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744413.890525:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890531:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890539:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:1.0:1788744413.890542:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744413.890545:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890550:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534200/0xb6207a6e76dcd0e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890593:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd0d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890609:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.890617:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744413.890619:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744413.890621:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535e00, rc 0) 00000100:00100000:1.0:1788744413.890686:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12464:x1875634138743552:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 820us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.890693:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:2.0:1788744413.895509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.895669:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138743808 00000100:00100000:0.0:1788744413.895679:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138743808 00000100:00100000:0.0:1788744413.895743:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:0.0:1788744413.895753:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12464:x1875634138743808:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744413.895775:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.895795:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd0ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d783 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.895915:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.895929:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 67 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.895951:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.895959:0:7792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.895992:0:7792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.896005:0:7792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 67 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.896018:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521472:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744413.896123:0:7792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 67 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.896140:0:7792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 67 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744413.896155:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521600:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744413.896177:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744413.901802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.901899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744413.901988:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138743936 00000100:00100000:3.0:1788744413.901998:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138743936 00010000:00010000:3.0:1788744413.902036:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 68 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.902074:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138744064 00000100:00100000:3.0:1788744413.902077:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138744064 00010000:00010000:3.0:1788744413.902089:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 69 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.902111:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:3.0:1788744413.902119:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:2394:x1875634138743936:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744413.902148:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744413.902156:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 69 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.902169:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 69 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744413.902179:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:1.0:1788744413.902189:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:2394:x1875634138744064:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744413.902191:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744413.902196:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.902197:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744413.902204:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.902206:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 69 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744413.902211:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744413.902216:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 69 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.902227:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744413.902229:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.902236:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.902243:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744413.902256:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+69:2394:x1875634138743936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 138us (463us total) trans 0 rc 0/0 00010000:00010000:1.0:1788744413.902259:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744413.902262:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:1.0:1788744413.902278:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:2394:x1875634138744064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 92us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.902284:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00010000:00010000:2.0:1788744413.902756:0:7792:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000007fa4de98 x1875634154521472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 67 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.902771:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535e00/0xb6207a6e76dcd0e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d77c expref: 67 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.902786:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521472:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744413.902799:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd0be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d76e expref: 66 pid: 7792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744413.902810:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154521600:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744413.902836:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744413.902842:0:7792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.902850:0:7792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.902856:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744413.902876:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788744413.903017:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd0ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 67 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.903032:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 66 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744413.903040:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744413.903043:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744413.903045:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dade00, rc 0) 00000100:00100000:2.0:1788744413.903504:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12464:x1875634138743808:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 7751us (8003us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788744413.903513:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:2.0:1788744413.906843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.910615:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138744320 00000100:00100000:1.0:1788744413.910696:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138744320 00000100:00100000:1.0:1788744413.910791:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1788744413.910803:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12464:x1875634138744320:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:1.0:1788744413.910832:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744413.910857:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd047 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d752 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.910885:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744413.910906:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744413.911907:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12464:x1875634138744320:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 1098us (5074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.911918:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788744413.925157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744413.928735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138744448 00000100:00100000:1.0:1788744413.928751:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138744448 00000100:00100000:1.0:1788744413.928886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:1.0:1788744413.928898:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12464:x1875634138744448:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:1.0:1788744413.929019:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.929036:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744413.929047:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744413.929187:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788744413.929282:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12464:x1875634138744448:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 386us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744413.929291:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:2.0:1788744413.933942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744413.934101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138744576 00000100:00100000:0.0:1788744413.934113:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138744576 00000100:00100000:0.0:1788744413.934194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:0.0:1788744413.934205:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6445b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+65:12464:x1875634138744576:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744413.934230:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744413.934252:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d78a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.934323:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.934334:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.934350:0:6516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.934362:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.934375:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744413.934378:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744413.934381:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744413.934778:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad600, rc 0) 00000100:00100000:0.0:1788744413.934878:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6445b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12464:x1875634138744576:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 673us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744413.934887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 230 00000040:00080000:0.0:1788744414.190691:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744414.190705:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744414.190742:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:0.0:1788744414.190750:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744414.190889:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154521728:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744414.191004:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744414.193892:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154521728:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744414.198788:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.200727:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138744704 00000100:00100000:2.0:1788744414.200743:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138744704 00000100:00100000:2.0:1788744414.200836:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:2.0:1788744414.200847:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12465:x1875634138744704:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744414.200900:0:7792:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744414.201032:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12465:x1875634138744704:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 186us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.201041:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:2.0:1788744414.209574:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.217989:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138744832 00000100:00100000:0.0:1788744414.218004:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138744832 00000100:00100000:0.0:1788744414.218750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:0.0:1788744414.218764:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12465:x1875634138744832:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788744414.218851:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218868:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218880:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218895:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218903:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218910:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218933:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218962:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.218970:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744414.219015:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788744414.219020:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744414.219031:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219042:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219049:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219056:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219062:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744414.219066:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219074:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219085:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:0.0:1788744414.219088:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744414.219093:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219109:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd112 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219126:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219133:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219139:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219144:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744414.219147:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219153:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219161:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9ac642257a00) 00010000:00010000:0.0:1788744414.219163:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744414.219166:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219171:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd119 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219186:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219192:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219204:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219209:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744414.219213:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219219:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219227:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744414.219229:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744414.219232:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.219238:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd120 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.219327:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12465:x1875634138744832:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 565us (9761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.219334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:0.0:1788744414.222034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.222206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138745088 00000100:00100000:3.0:1788744414.222217:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138745088 00000100:00100000:3.0:1788744414.222266:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:3.0:1788744414.222277:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+66:12465:x1875634138745088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744414.222299:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744414.222318:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd127 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d791 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222456:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222485:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222497:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744414.222510:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788744414.222590:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222599:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222605:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222612:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744414.222616:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222623:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222635:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744414.222638:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744414.222642:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222647:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd12e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222687:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd127 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d791 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222704:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:3.0:1788744414.222706:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744414.222711:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd127 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d791 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.222721:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:3.0:1788744414.222788:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12465:x1875634138745088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 513us (764us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788744414.222795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:3.0:1788744414.225253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.225521:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138745216 00000100:00100000:0.0:1788744414.225532:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138745216 00000100:00100000:0.0:1788744414.225598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:0.0:1788744414.225608:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12465:x1875634138745216:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744414.225811:0:6517:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744414.225936:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12465:x1875634138745216:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 327us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.225955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:0.0:1788744414.234735:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.235097:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138745472 00000100:00100000:2.0:1788744414.235108:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138745472 00000100:00100000:2.0:1788744414.235170:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:2.0:1788744414.235184:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12465:x1875634138745472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744414.235224:0:10509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744414.235227:0:10509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744414.235254:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd0cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d775 expref: 67 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.235275:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744414.235281:0:10509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744414.235296:0:10509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd13c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d798 expref: -99 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744414.235709:0:10509:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788744414.235861:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcd143 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.235876:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcd143 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.235887:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcd143 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.235940:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd13c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d798 expref: 69 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.235955:0:10509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcd143 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d798 expref: 68 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.235963:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac76020c900) 00010000:00010000:2.0:1788744414.235966:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744414.235976:0:10509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59400, rc 0) 00000100:00100000:2.0:1788744414.236038:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:12465:x1875634138745472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 857us (1313us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788744414.236047:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:2.0:1788744414.245179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.245512:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138745728 00000100:00100000:0.0:1788744414.245523:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138745728 00000100:00100000:0.0:1788744414.245582:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:0.0:1788744414.245592:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:12465:x1875634138745728:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744414.245660:0:7792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744414.245688:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59400/0xb6207a6e76dcd143 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d798 expref: 68 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245705:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac76020c900) 00010000:00010000:0.0:1788744414.245714:0:7792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744414.245732:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245746:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245756:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245807:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245814:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245830:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245888:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245895:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245902:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245908:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744414.245912:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245919:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245927:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:0.0:1788744414.245929:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744414.245933:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245939:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dadc00/0xb6207a6e76dcd151 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245949:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245954:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245960:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245969:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dacc00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744414.245972:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245978:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245984:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x42a98526 (ffff9ac642257a00) 00010000:00010000:0.0:1788744414.245986:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744414.245989:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.245994:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd158 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x42a98526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.246106:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12465:x1875634138745728:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 515us (937us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744414.246113:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:0.0:1788744414.263732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.263878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138745856 00000100:00100000:3.0:1788744414.263889:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138745856 00000100:00100000:3.0:1788744414.263946:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:3.0:1788744414.263956:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+67:12465:x1875634138745856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744414.263978:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744414.264000:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd15f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d79f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.264035:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.264049:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.264061:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.264181:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd15f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.264199:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.264209:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:3.0:1788744414.264211:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744414.264214:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf400, rc 0) 00000100:00100000:3.0:1788744414.264275:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:12465:x1875634138745856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 320us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744414.264281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:1.0:1788744414.267232:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.267304:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138746112 00000100:00100000:3.0:1788744414.267314:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138746112 00000100:00100000:3.0:1788744414.267376:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:3.0:1788744414.267396:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+68:12465:x1875634138746112:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744414.267498:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.267515:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.267527:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744414.267924:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788744414.267940:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395949537608ns, next at 396949535034ns, rc = 0 00000004:00010000:3.0:1788744414.268007:0:6515:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d63b797d reply state 0000000062e98872 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.268020:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.268028:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:3.0:1788744414.268031:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788744414.268034:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744414.269455:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+70:12465:x1875634138746112:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2053us (2223us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788744414.269466:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:1.0:1788744414.271934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.272112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138746240 00000100:00100000:2.0:1788744414.272124:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138746240 00000100:00100000:2.0:1788744414.272181:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:2.0:1788744414.272190:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+70:12465:x1875634138746240:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744414.272213:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744414.272231:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7a6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.272285:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.272299:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.272318:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.272321:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744414.272325:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59600, rc 0) 00000100:00100000:2.0:1788744414.272378:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+71:12465:x1875634138746240:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 189us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.272392:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:0.0:1788744414.274856:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.275051:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138746368 00000100:00100000:2.0:1788744414.275062:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138746368 00000100:00100000:2.0:1788744414.275134:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1788744414.275159:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2397:x1875634138746368:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788744414.275467:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744414.275562:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2397:x1875634138746368:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 404us (715us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788744414.275571:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788744414.282634:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.282728:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138746624 00000100:00100000:2.0:1788744414.282738:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138746624 00000100:00100000:2.0:1788744414.282795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788744414.282805:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+71:12465:x1875634138746624:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744414.283073:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+72:12465:x1875634138746624:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 269us (459us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788744414.283081:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:1.0:1788744414.288652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.288911:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138746880 00000100:00100000:0.0:1788744414.288926:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138746880 00000100:00100000:0.0:1788744414.289010:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:0.0:1788744414.289020:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7557a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+72:12465:x1875634138746880:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744414.289133:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7557a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+72:12465:x1875634138746880:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 115us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.289141:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:0.0:1788744414.298708:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.298841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747008 00000100:00100000:3.0:1788744414.298852:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747008 00000100:00100000:3.0:1788744414.298912:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:3.0:1788744414.298923:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+72:12465:x1875634138747008:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744414.298943:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744414.298963:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd17b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7ad expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.299036:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd182 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.299052:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.299063:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744414.299129:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744414.299149:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.299176:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd17b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7ad expref: 74 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.299192:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7ad expref: 73 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.299200:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:3.0:1788744414.299203:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788744414.299206:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf200, rc 0) 00000100:00100000:3.0:1788744414.299271:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+73:12465:x1875634138747008:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 350us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744414.299278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:1.0:1788744414.302072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.302229:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747136 00000100:00100000:0.0:1788744414.302238:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747136 00000100:00100000:0.0:1788744414.302287:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1788744414.302302:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+10:2394:x1875634138747136:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744414.302318:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744414.302336:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7b4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744414.302359:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e12df, blocks: 0x0 00010000:00010000:0.0:1788744414.302558:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788744414.302563:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744414.302574:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.302592:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.302605:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dadc00, rc 0) 00000100:00100000:0.0:1788744414.302665:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:2394:x1875634138747136:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 363us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.302672:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:1.0:1788744414.308216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.308296:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747392 00000100:00100000:3.0:1788744414.308306:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747392 00000100:00100000:3.0:1788744414.308365:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1788744414.308376:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+73:12465:x1875634138747392:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744414.308529:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+73:12465:x1875634138747392:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 155us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744414.308536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1788744414.312742:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.312851:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747520 00000100:00100000:0.0:1788744414.312862:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747520 00000100:00100000:0.0:1788744414.312930:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1788744414.312941:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+11:12465:x1875634138747520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744414.312978:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744414.312996:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7bb expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.313026:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.313037:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744414.313041:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744414.313046:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.313079:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.313093:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 12 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.313107:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875634154521856:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744414.313204:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744414.318207:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.318287:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747648 00000100:00100000:3.0:1788744414.318298:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747648 00010000:00010000:3.0:1788744414.318362:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 13 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744414.318767:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:1.0:1788744414.318788:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:2395:x1875634138747648:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744414.318806:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744414.318840:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 13 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.318855:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 13 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.318879:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744414.318883:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744414.318891:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 13 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.318906:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 13 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.318942:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 13 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744414.318955:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875634154521984:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788744414.319046:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75569e780 going to sleep for 11 seconds 00010000:00010000:0.0:1788744414.320015:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd189 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7b4 expref: 13 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.320034:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875634154521856:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744414.320057:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.320081:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dacc00, rc 0) 00000100:00100000:0.0:1788744414.320130:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:12465:x1875634138747520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 7191us (7396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.320139:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:3.0:1788744414.324340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.324899:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747776 00000100:00100000:0.0:1788744414.324910:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747776 00002000:00100000:0.0:1788744414.324957:0:8436:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9ac643e46680 x1875634138747776/t0(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:690/0 lens 504/0 e 0 to 0 dl 1788744425 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744414.324967:0:8436:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643e46680 with x1875634138747776 ext(0->12) 00002000:00010000:0.0:1788744414.324973:0:8436:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643e46680 00000100:00100000:0.0:1788744414.324996:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788744414.325006:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+12:2395:x1875634138747776:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788744414.326276:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2395:x1875634138747776:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1264us (1938us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788744414.326287:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00002000:00100000:0.0:1788744414.326296:0:8436:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9ac643e46680 x1875634138747776/t4294967321(0) o4->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:690/0 lens 504/448 e 0 to 0 dl 1788744425 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744414.326307:0:8436:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac643e46680 with x1875634138747776 ext(0->12) 00002000:00010000:0.0:1788744414.326313:0:8436:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac643e46680 00000100:00100000:2.0:1788744414.326456:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875634154521984:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788744414.326482:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744414.326508:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:2395:x1875634138747648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 7724us (8310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.326517:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:1.0:1788744414.331764:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.331937:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138747904 00000100:00100000:2.0:1788744414.331947:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138747904 00000100:00100000:2.0:1788744414.332034:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:2.0:1788744414.332045:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+73:12465:x1875634138747904:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788744414.333896:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788744414.333910:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788744414.333948:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788744414.333961:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac64379c540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788744414.333974:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac7480cea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac64379c180 00000020:00080000:1.0:1788744414.333977:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac7480ce400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac644470e00 00000004:00080000:1.0:1788744414.334000:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788744414.334024:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac753225180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788744414.334027:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac7447e5d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac743227600 00000020:00080000:1.0:1788744414.334029:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac7447e5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac6410ff800 00000020:00080000:1.0:1788744414.334040:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788744414.334211:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154522240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788744414.334278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744414.334341:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744414.334356:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154522112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788744414.334392:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744414.334441:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154522240 00000100:00100000:0.0:1788744414.334449:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154522240 00000100:00100000:0.0:1788744414.334496:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154522112 00000100:00100000:0.0:1788744414.334499:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154522112 00000100:00100000:0.0:1788744414.334514:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744414.334521:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1875634154522240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788744414.334654:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788744414.334658:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788744415 00002000:00010000:0.0:1788744414.334660:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788744414.334662:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788744415 -> 1788744415 00002000:00010000:0.0:1788744414.334663:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788744414.334701:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3643:x1875634154522240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (422us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788744414.334708:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744414.334723:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788744414.334730:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875634154522112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788744414.334741:0:8430:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788744414.334759:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.334779:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 12 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.334787:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788744414.334791:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744414.334804:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.334843:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 12 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.334857:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 12 pid: 8966 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.334869:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875634154522368:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744414.334930:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab96c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788744414.334961:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac644545880/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788744414.334966:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154522240:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788744414.335111:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335120:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335137:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335143:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bec00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.335148:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335155:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335172:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ac74505f300) 00010000:00010000:2.0:1788744414.335174:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.335179:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335184:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bec00/0xb6207a6e76dcce95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335214:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335220:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335225:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335230:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.335233:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335249:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335256:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ac76020c400) 00010000:00010000:2.0:1788744414.335258:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.335261:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335267:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bea00/0xb6207a6e76dccf3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335282:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335288:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335293:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335297:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.335300:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335305:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335312:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:2.0:1788744414.335314:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.335317:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335326:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dccfbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335338:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335345:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335351:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335356:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.335359:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335365:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335372:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac76020c500) 00010000:00010000:2.0:1788744414.335385:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.335388:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335393:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741534c00/0xb6207a6e76dccfde lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335442:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335449:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335459:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335464:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.335467:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335472:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335480:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744414.335482:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.335485:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335491:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad400/0xb6207a6e76dcd0b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335506:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335512:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335518:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335523:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfa00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.335526:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335541:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335550:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.335552:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788744414.335555:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.335560:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bfa00/0xb6207a6e76dcd16d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788744414.335640:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788744414.335687:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788744414.335772:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12465:x1875634138747904:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 3728us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.335781:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:0.0:1788744414.335982:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154522496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788744414.336019:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744414.336054:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154522496 00000100:00100000:0.0:1788744414.336060:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154522496 00000100:00100000:0.0:1788744414.336091:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744414.336098:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1875634154522496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788744414.336116:0:8966:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1788744414.336141:0:8966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e12de, atime: 0x6a9e12de, ctime: 0x6a9e12de, blocks: 0x8 00010000:00010000:0.0:1788744414.336148:0:8966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336159:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1788744414.336163:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744414.336176:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336190:0:8966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336199:0:8966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336207:0:8966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336223:0:8966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744414.336328:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1875634154522496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 230us (308us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788744414.336335:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788744414.336352:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744414.336357:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336364:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744414.336368:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336389:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336434:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336441:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd19e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.336456:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744414.336457:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744414.336459:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788744414.336482:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac644455880/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788744414.336488:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154522496:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788744414.336748:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744414.336753:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744414.340926:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744414.340965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.341031:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138748160 00000100:00100000:2.0:1788744414.341041:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138748160 00000100:00100000:2.0:1788744414.341097:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1788744414.341107:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+13:2395:x1875634138748160:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788744414.341491:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138748032 00000100:00100000:3.0:1788744414.341496:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138748032 00010000:00010000:3.0:1788744414.341520:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 14 pid: 8966 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744414.341551:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:3.0:1788744414.341558:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2394:x1875634138748032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744414.341570:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744414.341576:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 14 pid: 8966 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.341589:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 14 pid: 8966 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.341616:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744414.341626:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744414.341632:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.341642:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.341677:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744414.341724:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+14:2394:x1875634138748032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 166us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744414.341732:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00010000:00010000:0.0:1788744414.343846:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc1c04e7/0xb6207a6e76dccf4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d713 expref: 13 pid: 8966 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.343870:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875634154522368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744414.343894:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744414.343983:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788744414.343990:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00010000:00010000:1.0:1788744414.344083:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.344092:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.344103:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.344111:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744414.344137:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744414.344207:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744414.344215:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.344223:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744414.344227:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.344236:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.344254:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.344262:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd197 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.344282:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744414.344284:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744414.344286:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744414.344397:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138748160:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 3290us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.344438:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1788744414.347152:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154522112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12414us (12750us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788744414.347183:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788744414.347215:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1788744414.347222:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1788744414.347244:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac644545880, transno 4294967322 00000100:00100000:0.0:1788744414.347267:0:3645:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ac644545180 x1875634154522112/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788744430 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788744414.347278:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac644545180/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788744414.347288:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154522112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788744414.347981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.348048:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138748416 00000100:00100000:2.0:1788744414.348056:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138748416 00000100:00100000:2.0:1788744414.348105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:2.0:1788744414.348116:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12465:x1875634138748416:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744414.348177:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744414.348204:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf200/0xb6207a6e76dcd182 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7ad expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.348222:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.348227:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744414.348258:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.348272:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.348283:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744414.348370:0:6516:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008618c6a6 reply state 000000009d919802 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.348396:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.348458:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.348461:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788744414.348464:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744414.348556:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:12465:x1875634138748416:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 441us (576us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788744414.348563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:3.0:1788744414.351024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.351098:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138748544 00000100:00100000:0.0:1788744414.351108:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138748544 00000100:00100000:0.0:1788744414.351165:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:0.0:1788744414.351176:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138748544:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788744414.351316:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788744414.351320:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788744415 -> 1788744414 00002000:00010000:0.0:1788744414.351322:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788744414 00002000:00010000:0.0:1788744414.351325:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788744415 -> 1788744414 00002000:00010000:0.0:1788744414.351327:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788744414.351442:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138748544:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 225us (383us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788744414.351451:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1788744414.354132:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.354201:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138748800 00000100:00100000:2.0:1788744414.354210:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138748800 00000100:00100000:2.0:1788744414.354261:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:2.0:1788744414.354281:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:12465:x1875634138748800:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788744414.354339:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.354355:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.354364:0:7792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.354395:0:7792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.354436:0:7792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 22 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.354449:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154522624:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744414.354523:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744414.357912:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.358159:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138748928 00000100:00100000:2.0:1788744414.358169:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138748928 00010000:00010000:2.0:1788744414.358206:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 23 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.358248:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:2.0:1788744414.358259:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:2394:x1875634138748928:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744414.358272:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744414.358279:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 23 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.358304:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 23 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.358326:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.358331:0:10333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.358342:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.358350:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.358370:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744414.358456:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+23:2394:x1875634138748928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 198us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.358463:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00010000:00010000:0.0:1788744414.359138:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf400/0xb6207a6e76dcd166 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d79f expref: 22 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.359156:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154522624:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744414.359175:0:7792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359183:0:7792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359189:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359226:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359242:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359248:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359254:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744414.359258:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359266:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359275:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:0.0:1788744414.359278:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788744414.359282:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.359287:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd1ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.359349:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12465:x1875634138748800:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 5069us (5223us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788744414.359357:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:1.0:1788744414.361965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.362045:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138749056 00000100:00100000:2.0:1788744414.362055:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138749056 00000100:00100000:2.0:1788744414.362109:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788744414.362119:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138749056:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788744414.362156:0:8966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.362175:0:8966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.362199:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788744414.362203:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744414.362208:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.362240:0:8966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.362253:0:8966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 8 pid: 8431 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.362268:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8966:1875634154522752:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744414.362342:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744414.364752:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8966:1875634154522752:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744414.364784:0:8966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744414.366054:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.366724:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138749184 00000100:00100000:2.0:1788744414.366734:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138749184 00010000:00010000:2.0:1788744414.366771:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 9 pid: 8431 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.366814:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:2.0:1788744414.366832:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+9:2394:x1875634138749184:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744414.366846:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744414.366867:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 9 pid: 8431 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.366900:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 9 pid: 8431 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.366923:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e7a57a/0xb6207a6e76dcd190 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7bb expref: 9 pid: 8431 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.366940:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744414.366945:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744414.366950:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.366961:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.366997:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744414.367059:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2394:x1875634138749184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 228us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.367067:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00010000:00010000:0.0:1788744414.367510:0:8966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367527:0:8966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367547:0:8966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367554:0:8966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367563:0:8966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367570:0:8966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744414.367574:0:8966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367582:0:8966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367595:0:8966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.367603:0:8966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50d7e21/0xb6207a6e76dcd1b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.367682:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138749056:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 5564us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.367690:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1788744414.370858:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.370936:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138749440 00000100:00100000:2.0:1788744414.370947:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138749440 00000100:00100000:2.0:1788744414.371045:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:2.0:1788744414.371056:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:12465:x1875634138749440:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788744414.371131:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.371148:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 21 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.371170:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.371205:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 21 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.371218:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 21 pid: 10509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.371232:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154522880:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744414.371312:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64379cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744414.374582:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154522880:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744414.374615:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744414.374777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.374854:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138749568 00000100:00100000:2.0:1788744414.374861:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138749568 00010000:00010000:2.0:1788744414.374895:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 22 pid: 10509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.374933:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:2.0:1788744414.374942:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:2394:x1875634138749568:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744414.374956:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744414.374962:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 22 pid: 10509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.374992:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 22 pid: 10509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.375014:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd0a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d767 expref: 22 pid: 10509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.375031:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744414.375037:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.375047:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.375055:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.375062:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.375184:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744414.375238:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:2394:x1875634138749568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 296us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.375245:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 107 00010000:00010000:3.0:1788744414.376283:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.376305:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.376696:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.376712:0:10509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.376721:0:10509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.376758:0:10509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.376774:0:10509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 21 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744414.376787:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154523008:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744414.376956:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744414.380306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.380377:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138749696 00000100:00100000:2.0:1788744414.380394:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138749696 00010000:00010000:2.0:1788744414.380466:0:9517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 22 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744414.380526:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:2.0:1788744414.380536:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:2394:x1875634138749696:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744414.380551:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744414.380559:0:9517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 22 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.380570:0:9517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 22 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.380590:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.380596:0:9517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.380605:0:9517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.380613:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.380643:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744414.380691:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:2394:x1875634138749696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 156us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.380698:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00010000:00010000:3.0:1788744414.381176:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59600/0xb6207a6e76dcd174 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7a6 expref: 21 pid: 6516 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744414.381192:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154523008:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744414.381211:0:10509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.381220:0:10509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.381234:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744414.381337:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788744414.381490:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788744414.381529:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788744414.381604:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154523136:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788744414.381711:0:10509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744414.381740:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744414.382000:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154523136 00000100:00100000:2.0:1788744414.382008:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154523136 00000100:00100000:2.0:1788744414.382055:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788744414.382064:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10509:x1875634154523136:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788744414.382151:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10509:x1875634154523136:12345-0@lo:1000:mdt00_004.0 Request processed in 87us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.382159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788744414.382556:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154523136:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788744414.382677:0:10509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788744414.382727:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154523264:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788744414.382760:0:10509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744414.382786:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64270fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744414.382944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154523264 00000100:00100000:2.0:1788744414.382949:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154523264 00000100:00100000:2.0:1788744414.382984:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788744414.382992:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10509:x1875634154523264:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788744414.383099:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10509:x1875634154523264:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (337us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788744414.383106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788744414.383215:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10509:1875634154523264:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788744414.383250:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383260:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383268:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383274:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bee00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744414.383279:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383302:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383317:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:3.0:1788744414.383320:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744414.383325:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383331:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bee00/0xb6207a6e76dcd1c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383354:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383361:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383367:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383372:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744414.383375:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383394:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383604:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744414.383607:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744414.383614:0:10509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383751:0:10509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383760:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.383790:0:10509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744414.383802:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154523392:192.168.203.4@tcp:105: 00000100:00100000:3.0:1788744414.383931:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745579000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744414.387808:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10509:1875634154523392:192.168.203.4@tcp:105: 00010000:00010000:3.0:1788744414.387849:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387860:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535200/0xb6207a6e76dcd104 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387894:0:10509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387909:0:10509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387920:0:10509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387933:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387957:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387963:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387969:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744414.387973:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387981:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.387995:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744414.387998:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744414.388002:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388007:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd1c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388018:0:10509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388024:0:10509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388030:0:10509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388034:0:10509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744414.388043:0:10509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388050:0:10509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388058:0:10509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744414.388060:0:10509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744414.388062:0:10509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744414.388068:0:10509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58200/0xb6207a6e76dcd1ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744414.388285:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:12465:x1875634138749440:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 17230us (17434us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788744414.388296:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000020:00080000:3.0:1788744414.388302:0:10509:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788744414.389317:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.389657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138749824 00000100:00100000:2.0:1788744414.389666:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138749824 00000100:00100000:2.0:1788744414.389712:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1788744414.389722:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:12464:x1875634138749824:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:2.0:1788744414.389846:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:12464:x1875634138749824:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 125us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.389853:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000040:00080000:0.0:1788744414.390616:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744414.390622:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744414.391346:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1788744414.391360:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744414.391867:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.391944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744414.391994:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138750080 00000100:00100000:2.0:1788744414.392002:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138750080 00000100:00100000:2.0:1788744414.392043:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1788744414.392051:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+24:12465:x1875634138750080:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788744414.392286:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788744414.392320:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788744414.392357:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.392764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138750336 00000100:00100000:0.0:1788744414.392769:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138750336 00000100:00100000:0.0:1788744414.392807:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:0.0:1788744414.392816:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12464:x1875634138750336:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:0.0:1788744414.392926:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788744414.393042:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12464:x1875634138750336:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 227us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.393050:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 247 00010000:00010000:2.0:1788744414.393139:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393151:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393161:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393167:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393173:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393190:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744414.393223:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744414.393229:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393237:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744414.393241:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393248:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393258:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744414.393261:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788744414.393266:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393284:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcd1cf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.393296:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744414.393298:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744414.393299:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744414.393331:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+26:12465:x1875634138750080:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1280us (1468us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788744414.393338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000020:00080000:2.0:1788744414.393342:0:6519:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788744414.423132:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.423215:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138750464 00000100:00100000:0.0:1788744414.423225:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138750464 00000100:00100000:0.0:1788744414.423281:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:0.0:1788744414.423292:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+26:12467:x1875634138750464:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788744414.423314:0:7792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744414.423333:0:7792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd1d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7c2 expref: -99 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423390:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423520:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423532:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423547:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423554:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423561:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423710:0:7792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423722:0:7792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 27 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423742:0:7792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423776:0:7792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 27 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.423790:0:7792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 27 pid: 7792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.424018:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154523520:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744414.424368:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744414.427646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744414.427942:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138750720 00000100:00100000:3.0:1788744414.427953:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138750720 00000100:00100000:3.0:1788744414.428011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788744414.428022:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+28:6163:x1875634138750720:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744414.428245:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:6163:x1875634138750720:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 223us (606us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788744414.428252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:0.0:1788744414.428358:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7792:1875634154523520:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744414.428393:0:7792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744414.432019:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744414.432175:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138750848 00000100:00100000:0.0:1788744414.432185:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138750848 00010000:00010000:0.0:1788744414.432219:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 29 pid: 7792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744414.432255:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:0.0:1788744414.432264:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:2395:x1875634138750848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744414.432276:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744414.432282:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 29 pid: 7792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.432294:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 29 pid: 7792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.432312:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dade00/0xb6207a6e76dcd0f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d783 expref: 29 pid: 7792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.432328:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744414.432333:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.432347:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.432354:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744414.432389:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744414.432529:0:7792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432538:0:7792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744414.432583:0:7792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788744414.432587:0:7792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744414.432604:0:7792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432627:0:7792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432637:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432644:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432651:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432663:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.432667:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432675:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432684:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:2.0:1788744414.432686:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.432689:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432695:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd1dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432707:0:7792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432713:0:7792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432719:0:7792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432724:0:7792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744414.432726:0:7792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432731:0:7792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432747:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ac642257a00) 00010000:00010000:2.0:1788744414.432749:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744414.432752:0:7792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432758:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad800/0xb6207a6e76dcd1e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432790:0:7792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dace00/0xb6207a6e76dcd1d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7c2 expref: 29 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432802:0:7792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7c2 expref: 28 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744414.432825:0:7792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744414.432827:0:7792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744414.432829:0:7792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dacc00, rc 0) 00000100:00100000:2.0:1788744414.432885:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+28:12467:x1875634138750464:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 9595us (9763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.432893:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:0.0:1788744414.433062:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:2395:x1875634138750848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 798us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744414.433070:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00010000:00010000:0.0:1788744414.575382:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744414.575707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154523776:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.575774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.575837:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154524288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.575859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.575884:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154524800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.575903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.575939:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788744414.575945:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154523648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.575974:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.575996:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154524160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576022:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576040:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154524672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576059:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576086:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154523904:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576124:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154524416:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576158:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154524928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576179:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576198:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788744414.576203:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154524032:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576231:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154524544:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744414.576279:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154523776 00000100:00100000:2.0:1788744414.576287:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154523776 00000100:00100000:2.0:1788744414.576322:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524288 00000100:00100000:2.0:1788744414.576324:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524288 00000100:00100000:2.0:1788744414.576347:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524800 00000100:00100000:2.0:1788744414.576350:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524800 00000100:00100000:2.0:1788744414.576361:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524672 00000100:00100000:2.0:1788744414.576363:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524672 00000100:00100000:2.0:1788744414.576375:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524416 00000100:00100000:2.0:1788744414.576385:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524416 00000100:00100000:2.0:1788744414.576428:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524032 00000100:00100000:2.0:1788744414.576431:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524032 00000100:00100000:2.0:1788744414.576448:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788744414.576456:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154523776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576507:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154523776:12345-0@lo:400:kworker.0 Request processed in 52us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576514:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788744414.576531:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788744414.576537:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154524288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576564:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154524288:12345-0@lo:400:kworker.0 Request processed in 28us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576569:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788744414.576580:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788744414.576585:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154524800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576612:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154524800:12345-0@lo:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576617:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788744414.576629:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788744414.576634:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154524672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576657:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154524672:12345-0@lo:400:kworker.0 Request processed in 23us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576663:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788744414.576673:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788744414.576678:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154524416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576705:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154524416:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576717:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788744414.576729:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788744414.576734:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154524032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576761:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154524032:12345-0@lo:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576766:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788744414.576789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154523648 00000100:00100000:2.0:1788744414.576793:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154523648 00000100:00100000:2.0:1788744414.576828:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788744414.576835:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154523648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576863:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154523648:12345-0@lo:400:kworker.0 Request processed in 29us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788744414.576897:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524160 00000100:00100000:2.0:1788744414.576901:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524160 00000100:00100000:2.0:1788744414.576929:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154523904 00000100:00100000:2.0:1788744414.576932:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154523904 00000100:00100000:2.0:1788744414.576946:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788744414.576952:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154524160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.576982:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154524160:12345-0@lo:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.576988:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788744414.576999:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788744414.577005:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154523904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577031:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154523904:12345-0@lo:400:kworker.0 Request processed in 26us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.577047:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788744414.577084:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524928 00000100:00100000:2.0:1788744414.577088:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524928 00000100:00100000:2.0:1788744414.577110:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154524544 00000100:00100000:2.0:1788744414.577113:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154524544 00000100:00100000:2.0:1788744414.577131:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788744414.577137:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154524928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577166:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154524928:12345-0@lo:400:kworker.0 Request processed in 30us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.577172:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788744414.577182:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788744414.577187:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154524544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577211:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154524544:12345-0@lo:400:kworker.0 Request processed in 24us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744414.577216:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788744414.577231:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744414.577235:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744414.577237:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744414.577239:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744414.577273:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154524032:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577284:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154524544:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154523904:0@lo:400:kworker.0 00010000:00080000:2.0:1788744414.577305:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac644454700 x1875634154524416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744414.577315:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154524416:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577336:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154524928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154523648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577380:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154524160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577391:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154524672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577420:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154523776:0@lo:400:kworker.0 00000100:00100000:2.0:1788744414.577431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154524288:0@lo:400:kworker.0 00010000:00080000:2.0:1788744414.577442:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac644456680 x1875634154524800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744414.577451:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154524800:0@lo:400:kworker.0 00000001:00080000:1.0:1788744414.966225:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788744414.966242:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788744415.094530:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154525056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744415.094598:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.094669:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525056 00000100:00100000:0.0:1788744415.094677:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525056 00000100:00100000:0.0:1788744415.094725:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788744415.094734:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154525056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744415.094757:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788744415.094798:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154525056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.094805:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788744415.094863:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154525056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744415.094990:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744415.095001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154525184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744415.095031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.095085:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525184 00000100:00100000:0.0:1788744415.095090:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525184 00000100:00100000:0.0:1788744415.095119:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788744415.095126:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154525184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744415.095150:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788744415.095183:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154525184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.095189:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788744415.095218:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154525184:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788744415.258010:0:14702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744415.258019:0:14702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744415.258061:0:14702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1788744415.258067:0:14702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788744415.408512:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744415.408522:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744415.408548:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:3.0:1788744415.408555:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744415.408695:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154525312:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744415.408782:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac750196480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744415.415240:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13795:1875634154525312:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744415.415464:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744415.415686:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138750976 00000100:00100000:0.0:1788744415.415693:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138750976 00000100:00080000:2.0:1788744415.415753:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744415.415763:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:0.0:1788744415.415773:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12479:x1875634138750976:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744415.415803:0:10509:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744415.415908:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12479:x1875634138750976:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 136us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.415915:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1788744415.420695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744415.420794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138751232 00000100:00100000:2.0:1788744415.420803:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138751232 00000100:00100000:2.0:1788744415.420877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:2.0:1788744415.420888:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+27:12479:x1875634138751232:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744415.420908:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744415.420929:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcd1f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7c9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.421037:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd1f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.421065:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.421078:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744415.421091:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788744415.421203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59800/0xb6207a6e76dcd1f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7c9 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.421222:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7c9 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.421231:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:2.0:1788744415.421233:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744415.421237:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744415.421289:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:12479:x1875634138751232:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 403us (603us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788744415.421297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:3.0:1788744415.425935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744415.426239:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138751360 00000100:00100000:0.0:1788744415.426248:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138751360 00000100:00100000:0.0:1788744415.426335:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788744415.426346:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:2397:x1875634138751360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744415.426360:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744415.426383:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd1f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7c9 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.426416:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744415.426421:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744415.426467:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+28:2397:x1875634138751360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 123us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.426480:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788744415.433320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744415.433432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138751616 00000100:00100000:3.0:1788744415.433443:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138751616 00000100:00100000:3.0:1788744415.433502:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:3.0:1788744415.433515:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+28:12479:x1875634138751616:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788744415.433602:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433618:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433631:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433864:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433873:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433897:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433903:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744415.433907:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433916:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433931:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744415.433935:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744415.433941:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.433947:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd207 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744415.434063:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:12479:x1875634138751616:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 551us (752us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788744415.434071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 251 00000040:00080000:3.0:1788744415.434160:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744415.434165:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744415.434661:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:3.0:1788744415.434670:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744415.442943:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744415.443016:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138751872 00000100:00100000:0.0:1788744415.443026:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138751872 00000100:00100000:0.0:1788744415.443097:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1788744415.443106:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+29:12479:x1875634138751872:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788744415.443332:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:12479:x1875634138751872:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 226us (397us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788744415.443340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00010000:00010000:3.0:1788744415.598999:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744415.599129:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154525440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744415.599196:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744415.599330:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525440 00000100:00100000:1.0:1788744415.599339:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525440 00000100:00100000:1.0:1788744415.599396:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788744415.599434:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154525440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744415.599464:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744415.599505:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154525440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.599512:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788744415.599655:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154525440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744416.110805:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744416.110837:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154525568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744416.110922:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744416.111129:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525568 00000100:00100000:0.0:1788744416.111139:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525568 00000100:00100000:0.0:1788744416.111207:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788744416.111218:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154525568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744416.111240:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744416.111294:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154525568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744416.111302:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788744416.111375:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788744416.111381:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1788744416.111433:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac74394aa00, transno 4294967308 00000004:00080000:1.0:1788744416.111451:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788744416.111462:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac644455880, transno 4294967311 00000100:00100000:1.0:1788744416.111473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154525568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744416.111572:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744416.267252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267345:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267436:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267460:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744416.267512:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752256 00000100:00100000:3.0:1788744416.267521:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752256 00000100:00100000:3.0:1788744416.267573:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752768 00000100:00100000:3.0:1788744416.267576:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752768 00000100:00100000:3.0:1788744416.267591:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752128 00000100:00100000:3.0:1788744416.267593:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752128 00000100:00100000:3.0:1788744416.267605:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752640 00000100:00100000:3.0:1788744416.267607:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752640 00000100:00100000:3.0:1788744416.267638:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 311 00000100:00100000:3.0:1788744416.267648:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138752256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744416.267683:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752000 00000100:00100000:1.0:1788744416.267690:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752000 00000100:00100000:3.0:1788744416.267724:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138752256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744416.267725:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:1.0:1788744416.267738:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138752000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744416.267739:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 311 00000100:00100000:3.0:1788744416.267762:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 312 00000100:00100000:3.0:1788744416.267771:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138752768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744416.267778:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2394:x1875634138752000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744416.267785:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:3.0:1788744416.267819:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138752768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744416.267827:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 312 00000100:00100000:3.0:1788744416.267842:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 313 00000100:00100000:3.0:1788744416.268170:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:2394:x1875634138752128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744416.268205:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:2394:x1875634138752128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 344us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744416.273479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:1.0:1788744416.273510:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138752640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744416.273600:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2394:x1875634138752640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 108us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744416.273608:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:1.0:1788744416.273682:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752512 00000100:00100000:1.0:1788744416.273690:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752512 00000100:00100000:1.0:1788744416.273741:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138752384 00000100:00100000:1.0:1788744416.273744:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138752384 00000100:00100000:1.0:1788744416.273767:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:1.0:1788744416.273774:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138752512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744416.274151:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:0.0:1788744416.274164:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138752384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744416.276170:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2394:x1875634138752512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 2382us (8810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744416.276184:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00080000:2.0:1788744416.276414:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744416.276421:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744416.276424:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744416.276427:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744416.281201:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2394:x1875634138752384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 7023us (13722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744416.281218:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:3.0:1788744416.281362:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 313 00000040:00080000:0.0:1788744416.431658:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788744416.496653:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744416.496663:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744416.496758:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788744416.496766:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788744416.634834:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744417.135677:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744417.135701:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154525696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744417.135807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744417.135879:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525696 00000100:00100000:0.0:1788744417.135887:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525696 00000100:00100000:0.0:1788744417.135936:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788744417.135946:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154525696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744417.135984:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744417.136044:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154525696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744417.136052:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788744417.136137:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154525696:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788744417.167669:0:14753:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744417.167678:0:14753:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744417.167709:0:14753:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788744417.167715:0:14753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744417.370626:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744417.370666:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753024 00000100:00100000:3.0:1788744417.370676:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753024 00000100:00100000:3.0:1788744417.370736:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:3.0:1788744417.370746:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+30:12500:x1875634138753024:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744417.370767:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744417.370790:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcd20e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.370933:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd215 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.370948:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd215 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.370963:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd215 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744417.370975:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788744417.371097:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be200/0xb6207a6e76dcd20e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7d0 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.371115:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd215 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7d0 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.371124:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:3.0:1788744417.371127:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788744417.371131:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:3.0:1788744417.371190:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:12500:x1875634138753024:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 445us (571us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788744417.371197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00080000:3.0:1788744417.371219:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744417.375725:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744417.375856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753152 00000100:00100000:0.0:1788744417.375867:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753152 00000100:00100000:0.0:1788744417.375920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:0.0:1788744417.375931:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:12500:x1875634138753152:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788744417.375994:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376012:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376025:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376061:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376069:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376089:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376095:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744417.376100:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376107:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376119:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:0.0:1788744417.376122:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744417.376127:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.376134:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd223 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744417.376203:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+32:12500:x1875634138753152:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 274us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744417.376210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:3.0:1788744417.481641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744417.484028:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753280 00000100:00100000:1.0:1788744417.484060:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753280 00000100:00100000:1.0:1788744417.484144:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:1.0:1788744417.484155:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138753280:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1788744417.484176:0:8966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744417.484196:0:8966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057393fa/0xb6207a6e76dcd22a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7d7 expref: -99 pid: 8966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744417.484222:0:8966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e12de, atime: 0x6a9e12de, ctime: 0x6a9e12de, blocks: 0x8 00010000:00010000:1.0:1788744417.484243:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1788744417.484248:0:8966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744417.484257:0:8966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057393fa/0xb6207a6e76dcd22a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7d7 expref: 8 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744417.484290:0:8966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057393fa/0xb6207a6e76dcd22a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7d7 expref: 8 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744417.484304:0:8966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535e00, rc 0) 00000100:00100000:1.0:1788744417.484759:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2395:x1875634138753280:12345-192.168.203.4@tcp:101:cat.0 Request processed in 603us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744417.484766:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1788744417.500136:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744417.500862:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753408 00000100:00100000:2.0:1788744417.500873:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753408 00002000:00100000:2.0:1788744417.500925:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9ac745070a80 x1875634138753408/t0(0) o3->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:693/0 lens 488/0 e 0 to 0 dl 1788744428 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744417.500955:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac745070a80 with x1875634138753408 ext(0->4095) 00002000:00010000:2.0:1788744417.500961:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac745070a80 00000100:00100000:2.0:1788744417.501058:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788744417.501069:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2397:x1875634138753408:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:2.0:1788744417.501224:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+8:2397:x1875634138753408:12345-192.168.203.4@tcp:3:cat.0 Request processed in 157us (1096us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788744417.501231:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00002000:00100000:2.0:1788744417.501238:0:8435:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9ac745070a80 x1875634138753408/t0(0) o3->e50f0a12-1dec-4e87-aa9a-b50e34f62300@192.168.203.4@tcp:693/0 lens 488/4536 e 0 to 0 dl 1788744428 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744417.501246:0:8435:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac745070a80 with x1875634138753408 ext(0->4095) 00002000:00010000:2.0:1788744417.501250:0:8435:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ac745070a80 00010000:00010000:0.0:1788744417.646655:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744418.158753:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744418.158779:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154525824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744418.158862:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744418.159096:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525824 00000100:00100000:3.0:1788744418.159105:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525824 00000100:00100000:3.0:1788744418.159159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788744418.159178:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154525824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744418.159211:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788744418.159273:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154525824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744418.159280:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788744418.159382:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154525824:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744418.677849:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744419.696842:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744419.696973:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154526080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744419.697031:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154525952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744419.697104:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744419.697123:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154526592:0@lo:400:kworker.0 00000100:00100000:1.0:1788744419.697137:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154526464:0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744419.697172:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744419.697175:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154527104:0@lo:400:kworker.0 00000100:00100000:1.0:1788744419.697203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154526976:0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744419.697237:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744419.697241:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788744419.697250:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154526208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744419.697260:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154527488:0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744419.697287:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744419.697304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154526720:0@lo:400:kworker.0 00000100:00100000:1.0:1788744419.697310:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788744419.697318:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154526336:0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744419.697353:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526976 00000100:00100000:1.0:1788744419.697361:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526976 00000100:00100000:1.0:1788744419.697422:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527488 00000100:00100000:1.0:1788744419.697425:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527488 00000100:00100000:1.0:1788744419.697445:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788744419.697454:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154526976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697474:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154527232:0@lo:400:kworker.0 00000100:00100000:1.0:1788744419.697506:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154526976:12345-0@lo:400:kworker.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.697510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744419.697559:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526080 00000100:00100000:3.0:1788744419.697563:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526080 00000100:00100000:3.0:1788744419.697585:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526592 00000100:00100000:3.0:1788744419.697588:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526592 00000100:00100000:3.0:1788744419.697598:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527104 00000100:00100000:3.0:1788744419.697600:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527104 00000100:00100000:3.0:1788744419.697610:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526720 00000100:00100000:3.0:1788744419.697612:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526720 00000100:00100000:3.0:1788744419.697623:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527232 00000100:00100000:3.0:1788744419.697625:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527232 00000100:00100000:3.0:1788744419.697640:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788744419.697646:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154526080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697679:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154526080:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.697684:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788744419.697697:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788744419.697703:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154526592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697739:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154526592:12345-0@lo:400:kworker.0 Request processed in 35us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.697746:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788744419.697747:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526464 00000100:00100000:0.0:1788744419.697753:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526464 00000100:00100000:0.0:1788744419.697800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526208 00000100:00100000:0.0:1788744419.697809:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526208 00000100:00100000:0.0:1788744419.697824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788744419.697830:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154526464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744419.697863:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154526464:12345-0@lo:400:kworker.0 Request processed in 33us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744419.697869:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788744419.697880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788744419.697886:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154526208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.697899:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788744419.697908:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154527104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744419.697914:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154526208:12345-0@lo:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744419.697921:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788744419.697948:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875634154527104:12345-0@lo:400:kworker.0 Request processed in 42us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.697955:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788744419.697959:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788744419.697974:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788744419.697982:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154526720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.698008:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154526720:12345-0@lo:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.698014:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788744419.698029:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788744419.698031:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154525952 00000100:00100000:3.0:1788744419.698036:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154527232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698037:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154525952 00000100:00100000:3.0:1788744419.698070:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154527232:12345-0@lo:400:kworker.0 Request processed in 33us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744419.698074:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788744419.698085:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788744419.698086:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154525952:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788744419.698117:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744419.698123:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3646:x1875634154525952:12345-0@lo:400:kworker.0 Request processed in 41us (1018us total) trans 0 rc 0/0 00000100:00080000:3.0:1788744419.698124:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744419.698127:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744419.698132:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744419.698135:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788744419.698204:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744419.698222:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154526848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698241:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744419.698250:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154527360:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698264:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744419.698291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154525952:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698301:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154526464:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698311:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154526976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154526208:0@lo:400:kworker.0 00010000:00080000:2.0:1788744419.698367:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f2b480 x1875634154526720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744419.698378:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154526720:0@lo:400:kworker.0 00010000:00080000:2.0:1788744419.698386:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f29c00 x1875634154527232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744419.698394:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154527232:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698427:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154526080:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698435:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154526592:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698444:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875634154527104:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698467:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526336 00000100:00100000:2.0:1788744419.698470:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526336 00000100:00100000:2.0:1788744419.698491:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788744419.698497:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154526336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698540:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154526336:12345-0@lo:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744419.698546:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788744419.698567:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154526336:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.698638:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154526848 00000100:00100000:2.0:1788744419.698641:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154526848 00000100:00100000:0.0:1788744419.701895:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788744419.701955:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154527488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744419.702137:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875634154527488:12345-0@lo:400:kworker.0 Request processed in 198us (4849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.706547:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527360 00000100:00100000:3.0:1788744419.706561:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527360 00000100:00100000:2.0:1788744419.706733:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744419.706746:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154526848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.706845:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154526848:12345-0@lo:400:kworker.0 Request processed in 102us (8601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744419.706853:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788744419.706897:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744419.706901:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744419.706942:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154526848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744419.706957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154527488:0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.707238:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744419.707246:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154527360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744419.707303:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154527360:12345-0@lo:400:kworker.0 Request processed in 58us (9037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744419.707309:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744419.707331:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154527360:0@lo:400:kworker.0 00000100:00100000:0.0:1788744419.709273:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788744420.207109:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744420.207130:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154527616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744420.207193:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744420.207262:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527616 00000100:00100000:0.0:1788744420.207272:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527616 00000100:00100000:0.0:1788744420.207318:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744420.207328:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154527616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744420.207358:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788744420.207429:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154527616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744420.207447:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744420.207495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154527616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744420.207689:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744420.207699:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154527744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744420.207729:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744420.207802:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527744 00000100:00100000:2.0:1788744420.207807:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527744 00000100:00100000:2.0:1788744420.207832:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744420.207838:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875634154527744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744420.207850:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788744420.207879:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875634154527744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744420.207884:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744420.207915:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154527744:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788744420.210641:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788744420.210674:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac64270f6c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788744420.210679:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac775c17c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac64270f000 00000020:00080000:0.0:1788744420.210682:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ac775c17900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac643232000 00000020:00080000:0.0:1788744420.210699:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1788744420.210813:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744420.210838:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744420.210845:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744420.210851:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744420.210857:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744420.210864:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744420.210879:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ac74505f800) 00010000:00010000:2.0:1788744420.210882:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744420.210887:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744420.210893:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58c00/0xb6207a6e76dcd1a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788744420.210927:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788744420.210993:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1788744420.213346:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1788744420.213359:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1788744420.719661:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744420.719845:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154527872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744420.719989:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744420.720137:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154527872 00000100:00100000:2.0:1788744420.720148:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154527872 00000100:00100000:2.0:1788744420.720218:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788744420.720238:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154527872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744420.720267:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744420.720310:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154527872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744420.720331:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788744420.720590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154527872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744421.231073:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744421.231100:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154528000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744421.231198:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744421.237730:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528000 00000100:00100000:1.0:1788744421.237747:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528000 00000100:00100000:1.0:1788744421.237847:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788744421.237861:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac775d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154528000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744421.237889:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744421.237976:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac775d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154528000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744421.237984:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788744421.238299:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744421.238393:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154528000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744421.403112:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744421.403158:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744421.403190:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744421.403209:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744421.403236:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753792 00000100:00100000:0.0:1788744421.403245:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753792 00000100:00100000:0.0:1788744421.403300:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754304 00000100:00100000:1.0:1788744421.403396:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 321 00000100:00100000:1.0:1788744421.403432:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138753792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744421.403509:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138753792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744421.403530:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 321 00000100:00100000:0.0:1788744421.403589:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754304 00000100:00100000:3.0:1788744421.403678:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753536 00000100:00100000:3.0:1788744421.403683:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753536 00000100:00100000:3.0:1788744421.403709:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 389 00000100:00100000:3.0:1788744421.403716:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138753536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744421.403744:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2396:x1875634138753536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744421.403750:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 389 00000100:00100000:3.0:1788744421.403792:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754048 00000100:00100000:3.0:1788744421.403796:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754048 00000100:00100000:3.0:1788744421.403827:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1788744421.403834:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138754048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744421.403862:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2396:x1875634138754048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744421.403868:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1788744421.403906:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744421.407549:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744421.407598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744421.407684:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753664 00000100:00100000:0.0:1788744421.407695:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753664 00000100:00100000:0.0:1788744421.407752:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 322 00000100:00100000:0.0:1788744421.407763:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138754304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744421.407856:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138754304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 95us (4645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744421.407864:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 322 00000100:00100000:0.0:1788744421.407881:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 323 00000100:00100000:0.0:1788744421.407898:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2396:x1875634138753664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744421.407924:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2396:x1875634138753664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744421.407929:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 323 00000100:00080000:0.0:1788744421.407947:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744421.407952:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744421.407955:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744421.408378:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138753920 00000100:00100000:1.0:1788744421.408384:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138753920 00000100:00100000:1.0:1788744421.408441:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:1.0:1788744421.408448:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138753920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744421.408480:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2396:x1875634138753920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744421.408486:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00080000:0.0:1788744421.409167:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744421.410044:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754176 00000100:00100000:0.0:1788744421.410059:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754176 00000100:00100000:0.0:1788744421.410114:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 324 00000100:00100000:0.0:1788744421.410123:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138754176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744421.410175:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2396:x1875634138754176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744421.410182:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 324 00000100:00080000:3.0:1788744421.410558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788744421.743671:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744422.064944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744422.065048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754432 00000100:00100000:0.0:1788744422.065058:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754432 00000100:00100000:0.0:1788744422.065115:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:0.0:1788744422.065125:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:12153:x1875634138754432:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788744422.065217:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:12153:x1875634138754432:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744422.065235:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:0.0:1788744422.075622:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744422.075833:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754560 00000100:00100000:2.0:1788744422.075844:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754560 00000100:00100000:0.0:1788744422.075951:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:0.0:1788744422.075966:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:12153:x1875634138754560:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788744422.076076:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:12153:x1875634138754560:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 114us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744422.076084:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:3.0:1788744422.078927:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744422.079025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754816 00000100:00100000:2.0:1788744422.079035:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754816 00000100:00100000:2.0:1788744422.079088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1788744422.079098:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:12153:x1875634138754816:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744422.079303:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:12153:x1875634138754816:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 206us (383us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788744422.079311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1788744422.255644:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744422.255666:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154528128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744422.255732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744422.256056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528128 00000100:00100000:0.0:1788744422.256067:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528128 00000100:00100000:0.0:1788744422.256119:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788744422.256130:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154528128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744422.256165:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744422.256279:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154528128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744422.256286:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788744422.256575:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154528128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744422.766578:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744423.278700:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744423.278725:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154528256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744423.278813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744423.278936:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528256 00000100:00100000:0.0:1788744423.278945:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528256 00000100:00100000:0.0:1788744423.278997:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788744423.279007:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7603fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154528256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744423.279042:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788744423.279094:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7603fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154528256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744423.279100:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788744423.279655:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154528256:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744423.796931:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744424.053852:0:14950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:27:03 (1788744423) 00000100:00100000:0.0:1788744424.815911:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154528640:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816029:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744424.816082:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154529152:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744424.816149:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154529664:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816171:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744424.816194:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788744424.816201:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154528768:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744424.816243:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154529280:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744424.816283:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154529792:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744424.816348:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528640 00000100:00100000:0.0:1788744424.816356:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528640 00000100:00100000:0.0:1788744424.816445:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788744424.816455:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154528640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816510:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154528640:12345-0@lo:400:kworker.0 Request processed in 57us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.816518:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788744424.816544:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529152 00000100:00100000:0.0:1788744424.816548:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529152 00000100:00100000:0.0:1788744424.816798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529664 00000100:00100000:0.0:1788744424.816803:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529664 00000100:00100000:0.0:1788744424.816822:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528768 00000100:00100000:0.0:1788744424.816825:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528768 00000100:00100000:0.0:1788744424.816840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788744424.816864:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154529152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816898:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154529152:12345-0@lo:400:kworker.0 Request processed in 36us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.816904:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788744424.816918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788744424.816924:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154529664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.816951:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154529664:12345-0@lo:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.816957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788744424.816969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788744424.816975:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154528768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.817002:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154528768:12345-0@lo:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.817008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788744424.817030:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529280 00000100:00100000:0.0:1788744424.817034:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529280 00000100:00100000:0.0:1788744424.817062:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529792 00000100:00100000:0.0:1788744424.817065:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529792 00000100:00100000:0.0:1788744424.817085:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744424.817092:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154529280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.817138:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154529280:12345-0@lo:400:kworker.0 Request processed in 32us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.817144:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744424.817156:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788744424.817163:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154529792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.817191:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154529792:12345-0@lo:400:kworker.0 Request processed in 29us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.817203:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788744424.817257:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744424.817261:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744424.817263:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788744424.817282:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744424.817311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154528768:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.817322:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154529280:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.817331:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154529792:0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.817341:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154528640:0@lo:400:kworker.0 00010000:00080000:0.0:1788744424.817352:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac644547800 x1875634154529152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744424.817363:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154529152:0@lo:400:kworker.0 00010000:00080000:0.0:1788744424.817373:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bf800 x1875634154529664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744424.817382:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154529664:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817585:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154528384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817625:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817651:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154528896:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817674:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817694:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154529408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817732:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154529920:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817762:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817792:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788744424.817798:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154528512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817821:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817838:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154529024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817876:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154529536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.817895:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744424.817921:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528512 00000100:00100000:2.0:1788744424.817925:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528512 00000100:00100000:2.0:1788744424.817947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529024 00000100:00100000:2.0:1788744424.817950:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529024 00000100:00100000:2.0:1788744424.817969:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529536 00000100:00100000:2.0:1788744424.817972:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529536 00000100:00100000:2.0:1788744424.817987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788744424.817993:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154528512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818033:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154528512:12345-0@lo:400:kworker.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744424.818040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788744424.818055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788744424.818061:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154529024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818088:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154529024:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744424.818094:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788744424.818106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788744424.818112:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154529536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818137:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154529536:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744424.818152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788744424.818173:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529408 00000100:00100000:2.0:1788744424.818177:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529408 00000100:00100000:2.0:1788744424.818199:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154529920 00000100:00100000:2.0:1788744424.818202:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154529920 00000100:00100000:2.0:1788744424.818216:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788744424.818221:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154529408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818250:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154529408:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744424.818256:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788744424.818267:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788744424.818272:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154529920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818296:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154529920:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744424.818301:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788744424.818319:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528896 00000100:00100000:2.0:1788744424.818322:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528896 00000100:00100000:2.0:1788744424.818341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788744424.818346:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154528896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818372:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154528896:12345-0@lo:400:kworker.0 Request processed in 26us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744424.818378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788744424.818424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154528512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154529024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818441:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154529536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818456:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154528896:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818464:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154529408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744424.818471:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788744424.818476:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac644545180, transno 4294967323 00000004:00080000:2.0:1788744424.818486:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788744424.818500:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154529920:0@lo:400:kworker.0 00000100:00080000:2.0:1788744424.818606:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744424.818610:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744424.818612:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744424.821652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154528384 00000100:00100000:0.0:1788744424.821670:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154528384 00000100:00100000:0.0:1788744424.821770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788744424.821780:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154528384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744424.821868:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3645:x1875634154528384:12345-0@lo:400:kworker.0 Request processed in 89us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744424.821875:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788744424.822301:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154528384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744425.327893:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744425.327932:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154530048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744425.327998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744425.329086:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530048 00000100:00100000:1.0:1788744425.329097:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530048 00000100:00100000:1.0:1788744425.329151:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788744425.329162:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154530048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744425.329193:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788744425.329264:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154530048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744425.329272:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788744425.329333:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154530048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744425.332415:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154530176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744425.332484:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744425.332676:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530176 00000100:00100000:1.0:1788744425.332686:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530176 00000100:00100000:1.0:1788744425.332761:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788744425.332771:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154530176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744425.332797:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788744425.332848:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154530176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744425.332856:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788744425.332908:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154530176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788744425.838887:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744425.839437:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744425.839467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154530304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744425.839563:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744425.839892:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530304 00000100:00100000:1.0:1788744425.839903:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530304 00000100:00100000:1.0:1788744425.839971:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788744425.839983:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154530304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744425.840020:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744425.840077:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154530304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744425.840085:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788744425.840190:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154530304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744426.352934:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744426.352966:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154530432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744426.353073:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744426.353246:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530432 00000100:00100000:1.0:1788744426.353258:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530432 00000100:00100000:1.0:1788744426.353336:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788744426.353348:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154530432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744426.353377:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744426.353463:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154530432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744426.353471:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788744426.353531:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154530432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744426.353651:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788744426.355254:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788744426.355269:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788744426.355327:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788744426.355343:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788744426.509534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744426.509589:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744426.509616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744426.509642:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744426.509658:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744426.509673:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744426.509695:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744426.509883:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755072 00000100:00100000:2.0:1788744426.509898:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755072 00000100:00100000:2.0:1788744426.509980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755584 00000100:00100000:2.0:1788744426.509984:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755584 00000100:00100000:2.0:1788744426.510000:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755200 00000100:00100000:2.0:1788744426.510002:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755200 00000100:00100000:2.0:1788744426.510035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755712 00000100:00100000:2.0:1788744426.510039:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755712 00000100:00100000:2.0:1788744426.510058:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 331 00000100:00100000:2.0:1788744426.510069:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2395:x1875634138755072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.510176:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:2395:x1875634138755072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 108us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.510185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 331 00000100:00100000:2.0:1788744426.510206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 332 00000100:00100000:2.0:1788744426.510212:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138755584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.510238:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138755584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.510245:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 332 00000100:00100000:2.0:1788744426.510257:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 333 00000100:00100000:2.0:1788744426.510263:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138755200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.510286:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138755200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.510292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 333 00000100:00100000:2.0:1788744426.510303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 334 00000100:00100000:2.0:1788744426.510310:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138755712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.510331:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2395:x1875634138755712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.510337:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 334 00000100:00100000:2.0:1788744426.510364:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138754944 00000100:00100000:2.0:1788744426.510368:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138754944 00000100:00080000:0.0:1788744426.512305:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744426.512319:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744426.512823:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 391 00000100:00100000:2.0:1788744426.512860:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138754944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.512999:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f3ec557-dc0b-4724-8510-d5e7f831a82c+13:2395:x1875634138754944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 147us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.513007:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 391 00000100:00100000:2.0:1788744426.513063:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755328 00000100:00100000:2.0:1788744426.513072:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755328 00000100:00100000:2.0:1788744426.513123:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755456 00000100:00100000:2.0:1788744426.513126:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755456 00000100:00100000:2.0:1788744426.513144:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1788744426.513150:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138755328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.513175:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2395:x1875634138755328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.513181:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1788744426.513192:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1788744426.513198:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138755456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744426.513324:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2395:x1875634138755456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 124us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.513333:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00080000:0.0:1788744426.514102:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744426.514110:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788744426.677570:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788744426.734691:0:13795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744426.734705:0:13795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744426.734848:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788744426.734855:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744426.758733:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744426.758983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138755840 00000100:00100000:2.0:1788744426.758996:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138755840 00000100:00100000:2.0:1788744426.759088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 256 00000100:00100000:2.0:1788744426.759102:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:13171:x1875634138755840:12345-192.168.203.4@tcp:101:lsof.0 00010000:00010000:2.0:1788744426.759135:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744426.763419:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744426.763528:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744426.763543:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744426.763559:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744426.763608:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788744426.763613:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788744426.763654:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744426.763681:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58a00/0xb6207a6e76dcd231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7de expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744426.763702:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7de expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744426.763710:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:2.0:1788744426.763713:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744426.763717:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744426.763800:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:13171:x1875634138755840:12345-192.168.203.4@tcp:101:lsof.0 Request processed in 4701us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744426.763809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 256 00010000:00010000:0.0:1788744426.862668:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744427.375757:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154530560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744427.375883:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744427.376213:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530560 00000100:00100000:0.0:1788744427.376226:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530560 00000100:00100000:0.0:1788744427.376299:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788744427.376311:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154530560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744427.376373:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744427.376473:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154530560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744427.376491:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788744427.376837:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154530560:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788744427.886716:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744428.398840:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744428.398872:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154530688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744428.398974:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744428.399171:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530688 00000100:00100000:3.0:1788744428.399185:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530688 00000100:00100000:3.0:1788744428.399260:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788744428.399272:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154530688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744428.399318:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788744428.399384:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154530688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744428.399392:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788744428.399856:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154530688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744428.849894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744428.850012:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138756096 00000100:00100000:3.0:1788744428.850028:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138756096 00000100:00100000:3.0:1788744428.850169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1788744428.850184:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+18:13172:x1875634138756096:12345-192.168.203.4@tcp:35:umount.0 00000100:00080000:0.0:1788744428.856950:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744428.859843:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:13172:x1875634138756096:12345-192.168.203.4@tcp:35:umount.0 Request processed in 9651us (9951us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788744428.859869:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:0.0:1788744428.868290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744428.868593:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138756352 00000100:00100000:1.0:1788744428.868610:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138756352 00000100:00100000:1.0:1788744428.868773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1788744428.868788:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+19:13172:x1875634138756352:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:1.0:1788744428.869245:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:13172:x1875634138756352:12345-192.168.203.4@tcp:35:umount.0 Request processed in 459us (963us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788744428.869255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1788744428.874824:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744428.875046:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138756608 00000100:00100000:1.0:1788744428.875061:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138756608 00000100:00100000:1.0:1788744428.875673:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1788744428.875689:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac750212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:13172:x1875634138756608:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:1.0:1788744428.876019:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac750212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:13172:x1875634138756608:12345-192.168.203.4@tcp:35:umount.0 Request processed in 333us (1207us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788744428.876027:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1788744428.879700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744428.879982:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138756864 00000100:00100000:1.0:1788744428.879997:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138756864 00000100:00100000:1.0:1788744428.880081:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:1.0:1788744428.880093:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+21:13172:x1875634138756864:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:1.0:1788744428.880947:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:13172:x1875634138756864:12345-192.168.203.4@tcp:35:umount.0 Request processed in 851us (1256us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788744428.880957:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788744428.887265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744428.887326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744428.887357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744428.887472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744428.887505:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138757376 00000100:00100000:2.0:1788744428.887528:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138757376 00000100:00100000:2.0:1788744428.887646:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138757632 00000100:00100000:2.0:1788744428.887650:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138757632 00000100:00100000:2.0:1788744428.887676:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138757504 00000100:00100000:2.0:1788744428.887679:0:9517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138757504 00000100:00100000:2.0:1788744428.887702:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1788744428.887713:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+15:2395:x1875634138757376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744428.887741:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744428.887762:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83400/0xb6207a6e76dcc21d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d338 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744428.887783:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744428.887813:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788744428.887832:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f3ec557-dc0b-4724-8510-d5e7f831a82c+14:2395:x1875634138757632:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744428.887853:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788744428.887866:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+14:2395:x1875634138757376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 142us (610us total) trans 0 rc 0/0 00010000:00010000:1.0:1788744428.887878:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcc438 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d411 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744428.887880:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00010000:00010000:1.0:1788744428.887903:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744428.887916:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788744428.887929:0:9517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:2395:x1875634138757504:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744428.887941:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788744428.887953:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:2395:x1875634138757632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 127us (624us total) trans 0 rc 0/0 00010000:00010000:2.0:1788744428.887958:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4000/0xb6207a6e76dcc160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d2f9 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744428.887973:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:2.0:1788744428.887981:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744428.888017:0:9517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2395:x1875634138757504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 92us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744428.888024:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788744428.888078:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138757248 00000100:00100000:0.0:1788744428.888087:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138757248 00000100:00080000:2.0:1788744428.890774:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744428.896959:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:0.0:1788744428.896996:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+7:2393:x1875634138757248:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:0.0:1788744428.897047:0:8431:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc7aa 00000020:00010000:0.0:1788744428.897059:0:8431:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ac77f7d3000: total 0 00000100:00080000:0.0:1788744428.897065:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ac77f7d4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744428.897149:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788744428.897663:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2393:x1875634138757248:12345-192.168.203.4@tcp:9:umount.0 Request processed in 683us (10187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744428.897674:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000020:00010000:1.0:1788744428.897860:0:6504:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ac77f7d3000: total 0 00010000:00010000:1.0:1788744428.897916:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ac77f7d3000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788744428.897998:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057393fa/0xb6207a6e76dcd22a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7d7 expref: 4 pid: 8966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.898047:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b127908/0xb6207a6e76dccb69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5fb expref: 3 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.898069:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ac77f7d3000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788744428.898086:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744428.898088:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744428.898091:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744428.912002:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744428.918656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744428.918821:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138757760 00000100:00100000:2.0:1788744428.918835:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138757760 00000100:00100000:2.0:1788744428.918925:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1788744428.918949:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2393:x1875634138757760:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:2.0:1788744428.918995:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc53b 00000100:00080000:2.0:1788744428.919008:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ac7531fb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744428.919081:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788744428.919316:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+2:2393:x1875634138757760:12345-192.168.203.4@tcp:9:umount.0 Request processed in 372us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744428.919324:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00010000:00010000:1.0:1788744428.919634:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744428.923250:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744428.930776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744428.931062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138758784 00000100:00100000:2.0:1788744428.931080:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138758784 00000100:00100000:2.0:1788744428.931242:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:2.0:1788744428.931256:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+22:2393:x1875634138758784:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:2.0:1788744428.931302:0:6515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc16e 00000020:00010000:2.0:1788744428.931325:0:6515:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ac6436b3800: total 0 00000100:00080000:2.0:1788744428.931330:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9ac6436b5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744428.931366:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1788744428.931384:0:6504:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ac6436b3800: total 0 00010000:00010000:1.0:1788744428.931484:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ac6436b3800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788744428.931521:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744428.931535:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744428.931562:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be000/0xb6207a6e76dcca4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5ae expref: 21 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.931588:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac64354df00) 00010000:00010000:1.0:1788744428.931591:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1788744428.931592:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e50f0a12-1dec-4e87-aa9a-b50e34f62300+20:2393:x1875634138758784:12345-192.168.203.4@tcp:39:umount.0 Request processed in 340us (836us total) trans 4294967527 rc 0/0 00010000:00010000:1.0:1788744428.931595:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcc49a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d41f expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744428.931601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 257 00010000:00010000:1.0:1788744428.935046:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744428.935057:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744428.935070:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd10b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d78a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935103:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:1.0:1788744428.935184:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788744428.935190:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad200/0xb6207a6e76dcc511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d43b expref: 17 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935208:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744428.935211:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788744428.935214:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac741535800/0xb6207a6e76dccbe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d617 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935227:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744428.935229:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744428.935232:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dacc00/0xb6207a6e76dcd1eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7c2 expref: 15 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935244:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac762c95f00) 00010000:00010000:1.0:1788744428.935265:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744428.935271:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcc4b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d426 expref: 14 pid: 10509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935292:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744428.935295:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744428.935299:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad000/0xb6207a6e76dccb2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5e6 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935311:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ac74505fe00) 00010000:00010000:1.0:1788744428.935313:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788744428.935316:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac600/0xb6207a6e76dccb54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d5f4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935331:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ac64354ec00) 00010000:00010000:1.0:1788744428.935334:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744428.935338:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437be400/0xb6207a6e76dccecd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d6f0 expref: 11 pid: 7792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935352:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ac744e31200) 00010000:00010000:1.0:1788744428.935354:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744428.935358:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58800/0xb6207a6e76dcc80c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d514 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935372:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:1.0:1788744428.935374:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744428.935377:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac800/0xb6207a6e76dccbc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d610 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935423:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ac642257800) 00010000:00010000:1.0:1788744428.935427:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788744428.935434:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac6437bf000/0xb6207a6e76dcd215 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7d0 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744428.935471:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ac6436b3800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788744428.935508:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744428.935511:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744428.935513:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744428.940935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744428.941048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138758912 00000100:00100000:0.0:1788744428.941060:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138758912 00000100:00100000:0.0:1788744428.941155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 258 00000100:00100000:0.0:1788744428.941167:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+5:2393:x1875634138758912:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:0.0:1788744428.941217:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc175 00000100:00080000:0.0:1788744428.941241:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ac77f755000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744428.941277:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788744428.941288:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744428.941503:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744428.942442:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e50f0a12-1dec-4e87-aa9a-b50e34f62300+3:2393:x1875634138758912:12345-192.168.203.4@tcp:39:umount.0 Request processed in 1232us (1477us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788744428.942457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 258 00010000:00010000:1.0:1788744429.934941:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744429.939698:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154530816:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.939773:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154531072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744429.939807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744429.939815:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744429.939881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154531328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.939889:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154531200:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.939955:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154530944:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.940686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154531584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.940748:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744429.940773:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154532096:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.940795:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744429.940870:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531072 00000100:00100000:2.0:1788744429.940881:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531072 00000100:00100000:2.0:1788744429.940949:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788744429.940959:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154531072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.941029:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154531072:12345-0@lo:400:kworker.0 Request processed in 71us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744429.941037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788744429.941096:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154531072:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.941124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531584 00000100:00100000:2.0:1788744429.941128:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531584 00000100:00100000:2.0:1788744429.941173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532096 00000100:00100000:2.0:1788744429.941177:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532096 00000100:00100000:2.0:1788744429.941199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788744429.941205:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154531584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.941241:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154531584:12345-0@lo:400:kworker.0 Request processed in 36us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744429.941248:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788744429.941260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788744429.941265:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154532096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.941291:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154532096:12345-0@lo:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744429.941297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788744429.941506:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744429.941539:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154531840:0@lo:400:kworker.0 00000100:00100000:1.0:1788744429.941581:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744429.941601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154532352:0@lo:400:kworker.0 00000100:00100000:1.0:1788744429.941623:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744429.943121:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744429.943177:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154531456:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.943209:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788744429.943994:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744429.949499:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531328 00000100:00100000:3.0:1788744429.949528:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531328 00000100:00100000:3.0:1788744429.949610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788744429.949621:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154531328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.949926:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154531328:12345-0@lo:400:kworker.0 Request processed in 307us (8419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744429.949935:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:3.0:1788744429.950096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745070700 x1875634154531584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744429.950113:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154531584:0@lo:400:kworker.0 00010000:00080000:3.0:1788744429.950128:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac644455880 x1875634154532096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744429.950137:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154532096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.950170:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531840 00000100:00100000:3.0:1788744429.950175:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531840 00000100:00100000:3.0:1788744429.950214:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532352 00000100:00100000:3.0:1788744429.950218:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532352 00000100:00100000:3.0:1788744429.950244:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788744429.950251:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154531840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.950288:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154531840:12345-0@lo:400:kworker.0 Request processed in 38us (8707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744429.950295:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788744429.950308:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788744429.950314:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.950345:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154532352:12345-0@lo:400:kworker.0 Request processed in 32us (8721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744429.950351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788744429.950378:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744429.950382:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744429.950444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530816 00000100:00100000:3.0:1788744429.950448:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530816 00000100:00100000:3.0:1788744429.950476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788744429.950483:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154530816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.950942:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3644:x1875634154530816:12345-0@lo:400:kworker.0 Request processed in 186us (10862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744429.950951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788744429.951083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154530944 00000100:00100000:0.0:1788744429.951089:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154530944 00000100:00100000:0.0:1788744429.951110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531456 00000100:00100000:0.0:1788744429.951113:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531456 00000100:00100000:0.0:1788744429.951139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788744429.951146:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154530944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.951194:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154530944:12345-0@lo:400:kworker.0 Request processed in 47us (8078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744429.951203:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788744429.951219:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788744429.951248:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154531456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744429.951344:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154531456:12345-0@lo:400:kworker.0 Request processed in 114us (8135us total) trans 0 rc 0/0 00000100:00080000:2.0:1788744429.951867:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744429.951886:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744429.951946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154531712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.951993:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744429.952033:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154532224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.952068:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744429.952116:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531712 00000100:00100000:2.0:1788744429.952124:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531712 00000100:00100000:2.0:1788744429.952171:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532224 00000100:00100000:2.0:1788744429.952175:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532224 00000100:00100000:2.0:1788744429.952199:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788744429.952208:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154531712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.952254:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154531712:12345-0@lo:400:kworker.0 Request processed in 48us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744429.952262:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788744429.952280:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788744429.952285:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154532224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.953111:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154532224:12345-0@lo:400:kworker.0 Request processed in 821us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744429.953120:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1788744429.953152:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744429.953156:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744429.953197:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154531712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.953211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154532224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.953247:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531200 00000100:00100000:2.0:1788744429.953253:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531200 00000100:00100000:0.0:1788744429.956261:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154531456:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.956279:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154531968:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.956366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744429.956439:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154530944:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.956623:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154531840:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.956640:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154532352:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.956652:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788744429.956664:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154531328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.956964:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154531968 00000100:00100000:3.0:1788744429.956972:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154531968 00000100:00100000:3.0:1788744429.957043:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788744429.957053:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744429.957113:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154531968:12345-0@lo:400:kworker.0 Request processed in 61us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744429.957121:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:0.0:1788744429.958294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744429.958339:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154531968:0@lo:400:kworker.0 00000100:00100000:1.0:1788744429.958904:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788744429.964970:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788744429.965008:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154531200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744429.965163:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154531200:12345-0@lo:400:kworker.0 Request processed in 177us (13276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744429.965194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788744429.965814:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154531200:0@lo:400:kworker.0 00000100:00100000:3.0:1788744430.447769:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788744430.447799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154532480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744430.447903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744430.448000:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154532608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744430.448027:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744430.448125:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532480 00000100:00100000:0.0:1788744430.448137:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532480 00000100:00100000:0.0:1788744430.448187:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532608 00000100:00100000:0.0:1788744430.448190:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532608 00000100:00100000:0.0:1788744430.448209:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788744430.448219:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154532480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788744430.448259:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788744430.448334:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154532480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744430.448342:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788744430.448359:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788744430.448365:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154532608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744430.448375:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788744430.448423:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154532608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744430.448430:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788744430.448702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154532480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744430.448732:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154532608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744430.958820:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154532736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744430.958920:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744430.959076:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532736 00000100:00100000:2.0:1788744430.959087:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532736 00000100:00100000:2.0:1788744430.959164:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788744430.959176:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154532736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744430.959213:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788744430.959280:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154532736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744430.959287:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00010000:1.0:1788744430.959423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744430.959500:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154532736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744431.302845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744431.302906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744431.302958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744431.303059:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138759040 00000100:00100000:1.0:1788744431.303072:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138759040 00000100:00100000:1.0:1788744431.303151:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138759296 00000100:00100000:1.0:1788744431.303154:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138759296 00000100:00100000:1.0:1788744431.303176:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138759168 00000100:00100000:1.0:1788744431.303179:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138759168 00000100:00100000:1.0:1788744431.303195:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788744431.303205:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f3ec557-dc0b-4724-8510-d5e7f831a82c+12:2397:x1875634138759040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744431.303225:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744431.303257:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcc271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d34d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744431.303288:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744431.303552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1788744431.303564:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+11:2397:x1875634138759296:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744431.303576:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744431.303587:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcc431 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d40a expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744431.303598:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744431.303637:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+10:2397:x1875634138759296:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 76us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744431.303644:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1788744431.303665:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788744431.303671:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+9:2397:x1875634138759168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744431.303679:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744431.303688:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b82800/0xb6207a6e76dcc278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d37e expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744431.303696:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744431.303730:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f3ec557-dc0b-4724-8510-d5e7f831a82c+8:2397:x1875634138759168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 58us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744431.303737:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1788744431.304009:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f3ec557-dc0b-4724-8510-d5e7f831a82c+7:2397:x1875634138759040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 801us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744431.304016:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788744431.318825:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744431.318926:0:7792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138759552 00000100:00100000:3.0:1788744431.318940:0:7792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138759552 00000100:00100000:3.0:1788744431.319034:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:3.0:1788744431.319072:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+6:2393:x1875634138759552:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:3.0:1788744431.319128:0:7792:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc28d 00000020:00010000:3.0:1788744431.319138:0:7792:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ac6427db000: total 0 00000100:00080000:3.0:1788744431.319143:0:7792:0:(import.c:65:import_set_state_nolock()) ffff9ac6427df800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744431.319179:0:7792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788744431.319468:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2393:x1875634138759552:12345-192.168.203.4@tcp:39:umount.0 Request processed in 397us (657us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788744431.319476:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 259 00000020:00010000:1.0:1788744431.319910:0:6505:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ac6427db000: total 0 00010000:00010000:1.0:1788744431.319916:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744431.319979:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ac6427db000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788744431.320024:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac642257d00) 00010000:00010000:1.0:1788744431.320029:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744431.320039:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58400/0xb6207a6e76dcd238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7de expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744431.320078:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ac6427db000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788744431.320090:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744431.320091:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744431.320093:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744431.320551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744431.341930:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744431.342036:0:10509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138759680 00000100:00100000:1.0:1788744431.342059:0:10509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138759680 00000100:00100000:1.0:1788744431.342143:0:10509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 260 00000100:00100000:1.0:1788744431.342155:0:10509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+5:2393:x1875634138759680:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:1.0:1788744431.342207:0:10509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc286 00000100:00080000:1.0:1788744431.342218:0:10509:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744431.342265:0:10509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788744431.342868:0:10509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d3d8d0a9-44d4-48ca-8f27-65a3656deb18+3:2393:x1875634138759680:12345-192.168.203.4@tcp:39:umount.0 Request processed in 712us (952us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788744431.342879:0:10509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 260 00010000:00010000:3.0:1788744431.343889:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744431.346187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744431.417386:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744431.417693:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138759936 00000100:00100000:2.0:1788744431.417717:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138759936 00000100:00100000:2.0:1788744431.417786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:2.0:1788744431.417799:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+7:2393:x1875634138759936:12345-192.168.203.4@tcp:251:umount.0 00000020:00000080:2.0:1788744431.417864:0:6510:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc14b 00000020:00010000:2.0:1788744431.417876:0:6510:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ac6433cd800: total 0 00000100:00080000:2.0:1788744431.417883:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cc000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788744431.417971:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f3ec557-dc0b-4724-8510-d5e7f831a82c+3:2393:x1875634138759936:12345-192.168.203.4@tcp:251:umount.0 Request processed in 175us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744431.417979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 393 00000020:00010000:1.0:1788744431.418115:0:6504:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ac6433cd800: total 0 00010000:00010000:1.0:1788744431.418188:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ac6433cd800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788744431.418229:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740030200/0xb6207a6e76dcc224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d33f expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744431.418249:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ac6433cd800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788744431.418260:0:6504:0:(genops.c:885:class_export_put()) final put ffff9ac6433cd800/0f3ec557-dc0b-4724-8510-d5e7f831a82c 00010000:00010000:1.0:1788744431.418282:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744431.418284:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744431.418286:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744431.419275:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433cd800/0f3ec557-dc0b-4724-8510-d5e7f831a82c for MGS 00000020:00000080:2.0:1788744431.419340:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6433cc000 for MGS 00000100:00100000:3.0:1788744431.470826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154532864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744431.470929:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744431.471533:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532864 00000100:00100000:1.0:1788744431.471547:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532864 00000100:00100000:1.0:1788744431.471640:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788744431.471655:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154532864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744431.471686:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744431.471769:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154532864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744431.471777:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788744431.472007:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154532864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744431.472085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744431.983765:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744432.494811:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154532992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744432.494904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744432.495051:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154532992 00000100:00100000:0.0:1788744432.495074:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154532992 00000100:00100000:0.0:1788744432.495144:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744432.495156:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154532992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744432.495201:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788744432.495275:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154532992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744432.495284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744432.495340:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154532992:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788744432.497237:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00080000:2.0:1788744432.497267:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788744432.497272:0:6495:0:(genops.c:885:class_export_put()) final put ffff9ac6427db000/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00100000:2.0:1788744432.497295:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000001:00080000:2.0:1788744432.497300:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788744432.497313:0:6495:0:(genops.c:885:class_export_put()) final put ffff9ac6436b3800/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:1.0:1788744432.497452:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6427db000/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 for lustre-MDT0000 00000020:00000080:1.0:1788744432.497537:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6436b3800/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-MDT0000 00000020:00000080:1.0:1788744432.497571:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6427df800 for lustre-MDT0000 00000020:00000080:1.0:1788744432.497578:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6436b5800 for lustre-MDT0000 00010000:00010000:2.0:1788744433.007555:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744433.518664:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744433.518707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154533120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744433.518800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744433.518894:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533120 00000100:00100000:3.0:1788744433.518904:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533120 00000100:00100000:3.0:1788744433.518964:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788744433.518975:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154533120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744433.519020:0:7973:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788744433.519073:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154533120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744433.519081:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788744433.519157:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154533120:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1788744433.624822:0:15147:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788744433.651610:0:15147:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788744433.651686:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744433.651715:0:15147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744433.651723:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744433.651730:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744433.651761:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788744433.651768:0:15147:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788744433.651800:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744433.651805:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788744433.651813:0:15147:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788744433.651843:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac774a23000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788744433.651882:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154533248:0@lo:39:umount.0 00000100:00100000:3.0:1788744433.651961:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744433.652934:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744433.652948:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.652958:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac775b82000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744433.652962:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.652972:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744433.652980:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744433.652986:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744433.652989:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788744433.652991:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788744433.653032:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.653039:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744433.653072:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.653079:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac775b82000/0xb6207a6e76dcc1f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.653118:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744433.653120:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744433.653122:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744433.653133:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744433.653950:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154533376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744433.654031:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744433.657147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533248 00000100:00100000:2.0:1788744433.660119:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533376 00000100:00100000:2.0:1788744433.660143:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533376 00000100:00100000:0.0:1788744433.661961:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533248 00000100:00100000:0.0:1788744433.662062:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788744433.662074:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875634154533248:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788744433.662108:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd62 00000100:00080000:0.0:1788744433.662117:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ac7603aa800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788744433.662232:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875634154533248:12345-0@lo:39:umount.0 Request processed in 160us (10270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744433.662239:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1788744433.662261:0:6517:0:(genops.c:885:class_export_put()) final put ffff9ac7603ab000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788744433.662299:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7603ab000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1788744433.662459:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac774a23000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788744433.662484:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154533248:0@lo:39:umount.0 00000100:00080000:2.0:1788744433.662548:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744433.662553:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788744433.662558:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788744433.663634:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663653:0:15147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663660:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663667:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663704:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744433.663726:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744433.663733:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663763:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c4600 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744433.663767:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663776:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744433.663784:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744433.663790:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744433.663793:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788744433.663836:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663842:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744433.663871:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663877:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4600/0xb6207a6e76dcc201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc208 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663894:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.663896:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.663898:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.663910:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663918:0:15147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663931:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663938:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663948:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744433.663954:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663961:0:15147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663968:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663975:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.663986:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788744433.663994:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744433.663997:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664003:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c4e00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744433.664006:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664012:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744433.664024:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744433.664028:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744433.664030:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788744433.664032:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788744433.664048:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664053:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744433.664059:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664065:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4e00/0xb6207a6e76dcc105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc10c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664074:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744433.664077:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664083:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf600 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744433.664085:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664091:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744433.664098:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744433.664113:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788744433.664115:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788744433.664117:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788744433.664131:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664136:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744433.664151:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664158:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf600/0xb6207a6e76dcc469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664167:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.664169:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.664171:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744433.664180:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744433.664201:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154533760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744433.664280:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744433.664343:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664351:0:15147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664358:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664366:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664382:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744433.664386:0:15147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788744433.664389:0:15147:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788744433.664450:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744433.664455:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664461:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c5800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744433.664464:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664470:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744433.664476:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744433.664481:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744433.664483:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788744433.664485:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788744433.664498:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664504:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744433.664513:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664520:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5800/0xb6207a6e76dcbcc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcbcc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.664539:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.664540:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744433.664542:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744433.664554:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154533888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744433.664579:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788744433.664616:0:15147:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788744433.664621:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788744433.664626:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744433.664633:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:2.0:1788744433.664639:0:15147:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ac775e84000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744433.664645:0:15147:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ac642270000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744433.664650:0:15147:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ac774b03800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744433.664654:0:15147:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ac774b03000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788744433.664660:0:15147:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9ac744728000) has exports, disconnecting them 00000020:00080000:2.0:1788744433.664665:0:15147:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ac775e84000), last request at 1788744429 00000020:00000080:2.0:1788744433.664673:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc072 00000100:00080000:2.0:1788744433.664703:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac775e86800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788744433.664749:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788744433.664764:0:15147:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac775e84000): rc 0 00000020:00000080:2.0:1788744433.664767:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac775e84000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1788744433.665473:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744433.665504:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154533504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744433.666079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744433.666145:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744433.666153:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154533632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744433.666193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788744433.666379:0:15147:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ac642270000), last request at 1788744429 00000020:00000080:2.0:1788744433.666391:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbf53 00000100:00080000:2.0:1788744433.666430:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac642276000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788744433.666463:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788744433.666479:0:15147:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac642270000): rc 0 00000020:00000080:2.0:1788744433.666482:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac642270000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788744433.667465:0:15147:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ac774b03800), last request at 1788744213 00000020:00000080:2.0:1788744433.667475:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbe49 00000100:00080000:2.0:1788744433.667484:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac774b07000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788744433.667517:0:15147:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac774b03800): rc 0 00000020:00000080:2.0:1788744433.667520:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac774b03800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1788744433.669960:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744433.670000:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533760 00000100:00100000:1.0:1788744433.670015:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533760 00000100:00100000:1.0:1788744433.670089:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533888 00000100:00100000:1.0:1788744433.670093:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533888 00000100:00100000:1.0:1788744433.670109:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533504 00000100:00100000:1.0:1788744433.670112:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533504 00000100:00100000:1.0:1788744433.670127:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154533632 00000100:00100000:1.0:1788744433.670130:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154533632 00000100:00100000:1.0:1788744433.670154:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744433.670180:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+28:3646:x1875634154533760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744433.670201:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744433.670226:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437bf800/0xb6207a6e76dcc470 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc469 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.670248:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744433.670802:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+27:3646:x1875634154533760:12345-0@lo:103:ldlm_bl.0 Request processed in 635us (6518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.670816:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744433.670848:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744433.670859:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+26:3646:x1875634154533888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744433.670872:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744433.670887:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031200/0xb6207a6e76dcbcc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcbcc1 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.670919:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744433.670959:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+25:3646:x1875634154533888:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (6378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.670967:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744433.670993:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744433.671001:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+24:3643:x1875634154533504:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788744433.671004:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac7603aa800 for lustre-MDT0000 00010000:00010000:1.0:1788744433.671011:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1788744433.671021:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775e84000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788744433.671028:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c4c00/0xb6207a6e76dcc208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc201 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.671042:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744433.671082:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+23:3643:x1875634154533504:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (5006us total) trans 0 rc 0/0 00000020:00000080:0.0:1788744433.671084:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac642270000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1788744433.671095:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744433.671116:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744433.671124:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+22:3643:x1875634154533632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744433.671133:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1788744433.671135:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac775e86800 for lustre-MDT0000 00000020:00000080:0.0:1788744433.671143:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac642276000 for lustre-MDT0000 00010000:00010000:1.0:1788744433.671146:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c5600/0xb6207a6e76dcc10c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc105 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.671925:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744433.671979:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46c76a72-ee71-482d-9002-d7642a89bcb9+21:3643:x1875634154533632:12345-0@lo:103:ldlm_bl.0 Request processed in 856us (5784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.671988:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744433.672057:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154533888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744433.672069:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154533760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744433.672101:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744433.672133:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154533632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744433.672142:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154533504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744433.674796:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744433.674817:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+20:3645:x1875634154533376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744433.674839:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744433.674864:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061b400/0xb6207a6e76dcc1fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc1f3 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744433.674885:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744433.675338:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3645:x1875634154533376:12345-0@lo:103:ldlm_bl.0 Request processed in 526us (21305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744433.675369:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744433.675572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46c76a72-ee71-482d-9002-d7642a89bcb9:3645:1875634154533376:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788744433.677287:0:15147:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ac774b03000), last request at 1788744213 00000020:00000080:2.0:1788744433.677304:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbe11 00000100:00080000:2.0:1788744433.677317:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac774b01800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744433.677358:0:15147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:0.0:1788744433.677422:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788744433.677605:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac774b03800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788744433.677682:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac774b07000 for lustre-MDT0000 00000020:00080000:2.0:1788744433.677759:0:15147:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac774b03000): rc 0 00000004:00000080:2.0:1788744433.677769:0:15147:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7f9019afae0 00000100:00080000:2.0:1788744433.677795:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788744433.677799:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788744433.680005:0:15147:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788744433.680052:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac77c9e5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788744433.680142:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154534016:0@lo:39:umount.0 00000100:00100000:3.0:1788744433.680313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744433.680427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534016 00000100:00100000:0.0:1788744433.680442:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534016 00000100:00100000:0.0:1788744433.680529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788744433.680539:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875634154534016:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788744433.680571:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbeb9 00000100:00080000:0.0:1788744433.680580:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9ac77cadd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744433.680607:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788744433.683225:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788744433.683234:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788744433.683256:0:15147:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744433.683330:0:15147:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788744433.683370:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788744433.683894:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154534144:0@lo:9:umount.0 00000100:00100000:3.0:1788744433.683987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744433.684119:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534144 00000100:00100000:1.0:1788744433.684130:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534144 00000100:00100000:1.0:1788744433.684220:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744433.684231:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875634154534144:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744433.684268:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbff4 00000100:00080000:1.0:1788744433.684279:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ac7507fb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744433.684343:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788744433.684650:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3642:x1875634154534144:12345-0@lo:9:umount.0 Request processed in 420us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.684659:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1788744433.684703:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744433.685483:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744433.686172:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788744433.686179:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:0.0:1788744433.686196:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3642:x1875634154534016:12345-0@lo:39:umount.0 Request processed in 5647us (5873us total) trans 4294967301 rc 0/0 00000004:00080000:2.0:1788744433.686201:0:15147:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744433.686214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788744433.686263:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744433.686276:0:15147:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788744433.686451:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac775a45800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788744433.688517:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ac744728000) has no exports 00000100:00080000:3.0:1788744433.688653:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac77c9e5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788744433.688670:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154534016:0@lo:39:umount.0 00000100:00100000:3.0:1788744433.688711:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154534272:0@lo:9:umount.0 00000100:00100000:3.0:1788744433.688802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744433.688909:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788744433.688935:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788744433.688937:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744433.688941:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154534144:0@lo:9:umount.0 00000100:00100000:1.0:1788744433.689059:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534272 00000100:00100000:1.0:1788744433.689069:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534272 00000100:00100000:1.0:1788744433.689445:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744433.689457:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875634154534272:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744433.689504:0:8966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc136 00000100:00080000:1.0:1788744433.689516:0:8966:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744433.689573:0:8966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788744433.689754:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3642:x1875634154534272:12345-0@lo:9:umount.0 Request processed in 299us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.689763:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788744433.689893:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788744433.689908:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744433.690084:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775a45800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788744433.690128:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788744433.690256:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744433.690261:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154534272:0@lo:9:umount.0 00000020:00080000:2.0:1788744433.698901:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ac744728000) has no exports 00000020:00000080:2.0:1788744433.764005:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd1c 00000020:00000080:2.0:1788744433.764034:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac77490e000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788744433.764056:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788744433.764105:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77490e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788744433.764166:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744433.764180:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744433.764186:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9ac7749019c0) has no exports 00000020:00000080:3.0:1788744433.765206:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd15 00000020:00000080:3.0:1788744433.765219:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac77490b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744433.765306:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744433.765336:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788744433.765340:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac75d4b5800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788744433.765343:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac75d4b5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788744433.765350:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788744433.765744:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77490b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788744434.031160:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744434.033054:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744434.033063:0:9507:0:(genops.c:885:class_export_put()) final put ffff9ac6433c8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788744434.033091:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:0.0:1788744434.033094:0:9507:0:(genops.c:885:class_export_put()) final put ffff9ac77f7d3000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:2.0:1788744434.033163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433c8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788744434.033214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77f7d3000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-OST0001 00000020:00000080:2.0:1788744434.033246:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6433cf000 for lustre-OST0001 00000020:00000080:2.0:1788744434.033251:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77f7d4000 for lustre-OST0001 00000001:00100000:0.0:1788744434.035603:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744434.035611:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ac7507fa000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788744434.035639:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:0.0:1788744434.035641:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ac7531fc000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:2.0:1788744434.037889:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7507fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788744434.037957:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7531fc000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-OST0000 00000020:00000080:2.0:1788744434.037975:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac7507fb800 for lustre-OST0000 00000020:00000080:2.0:1788744434.037980:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac7531fb000 for lustre-OST0000 00000001:00100000:1.0:1788744434.045066:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788744434.045083:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788744434.045090:0:7447:0:(genops.c:885:class_export_put()) final put ffff9ac77c946800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788744434.045120:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00080000:1.0:1788744434.045126:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788744434.045129:0:7447:0:(genops.c:885:class_export_put()) final put ffff9ac6433c8000/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 00000001:00100000:1.0:1788744434.045134:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000001:00080000:1.0:1788744434.045138:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788744434.045140:0:7447:0:(genops.c:885:class_export_put()) final put ffff9ac77f757000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 00000020:00000080:0.0:1788744434.045356:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c946800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788744434.045463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433c8000/d3d8d0a9-44d4-48ca-8f27-65a3656deb18 for lustre-MDT0001 00000020:00000080:0.0:1788744434.045501:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77f757000/e50f0a12-1dec-4e87-aa9a-b50e34f62300 for lustre-MDT0001 00000020:00000080:0.0:1788744434.045523:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77cadd000 for lustre-MDT0001 00000020:00000080:0.0:1788744434.045529:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6433cb800 for lustre-MDT0001 00000020:00000080:0.0:1788744434.045533:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77f755000 for lustre-MDT0001 00000100:00100000:1.0:1788744435.054663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154534784:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.054702:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154534400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.054738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744435.054746:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744435.054782:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154534912:0@lo:400:kworker.0 00000100:00100000:3.0:1788744435.054797:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154534656:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.054803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744435.054820:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154535424:0@lo:400:kworker.0 00000100:00100000:3.0:1788744435.054824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744435.054904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154534528:0@lo:400:kworker.0 00000100:00100000:1.0:1788744435.055581:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154535296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.057001:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744435.057071:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534400 00000100:00100000:2.0:1788744435.057080:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534400 00000100:00100000:2.0:1788744435.057128:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788744435.057138:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3643:x1875634154534400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.057194:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74471fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46c76a72-ee71-482d-9002-d7642a89bcb9+19:3643:x1875634154534400:12345-0@lo:400:kworker.0 Request processed in 58us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744435.057201:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788744435.057609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534784 00000100:00100000:2.0:1788744435.057615:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534784 00000100:00100000:2.0:1788744435.057638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534912 00000100:00100000:2.0:1788744435.057641:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534912 00000100:00100000:2.0:1788744435.057697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534656 00000100:00100000:2.0:1788744435.057701:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534656 00000100:00100000:2.0:1788744435.057714:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788744435.057721:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154534912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.057758:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154534912:12345-0@lo:400:kworker.0 Request processed in 39us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744435.057765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788744435.057778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788744435.057782:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875634154534784:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788744435.057788:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788744435.057813:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875634154534784:12345-0@lo:400:kworker.0 Request processed in 30us (3066us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788744435.057819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788744435.057829:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788744435.057833:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875634154534656:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788744435.057838:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788744435.057861:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875634154534656:12345-0@lo:400:kworker.0 Request processed in 27us (3036us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788744435.057867:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788744435.057912:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154534400:0@lo:400:kworker.0 00010000:00080000:2.0:1788744435.057927:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745072d80 x1875634154534912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744435.057938:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154534912:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.057987:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535424 00000100:00100000:2.0:1788744435.057991:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535424 00000100:00100000:2.0:1788744435.058020:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744435.058034:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154535424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.058070:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154535424:12345-0@lo:400:kworker.0 Request processed in 38us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744435.058077:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744435.058103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154535424:0@lo:400:kworker.0 00000100:00080000:2.0:1788744435.058128:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744435.058132:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744435.060619:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744435.060668:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154535040:0@lo:400:kworker.0 00000100:00100000:0.0:1788744435.060717:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744435.060723:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154534528 00000100:00100000:2.0:1788744435.060731:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154534528 00000100:00100000:0.0:1788744435.060751:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535040 00000100:00100000:0.0:1788744435.060754:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535040 00000100:00100000:2.0:1788744435.060774:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788744435.060781:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875634154534528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744435.060788:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000020:00080000:2.0:1788744435.060789:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788744435.060794:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154535040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.060827:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875634154534528:12345-0@lo:400:kworker.0 Request processed in 46us (215us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744435.060828:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154535040:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744435.060834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788744435.060846:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1788744435.060860:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788744435.060941:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744435.060944:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154535040:0@lo:400:kworker.0 00000100:00080000:0.0:1788744435.060968:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788744435.060973:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ac775a47800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788744435.060977:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788744435.062896:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788744435.062902:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9ac775ba8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788744435.062906:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788744435.062912:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9ac775ba8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744435.062915:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 195 00000100:00080000:3.0:1788744435.062927:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ac775ba8000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744435.062960:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e92a00 x1875634154535552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744435.062995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154534656:0@lo:400:kworker.0 00000100:00100000:3.0:1788744435.063004:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154535168:0@lo:400:kworker.0 00000100:00100000:3.0:1788744435.063050:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744435.063112:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535168 00000100:00100000:3.0:1788744435.063119:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535168 00000100:00100000:3.0:1788744435.063152:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788744435.063158:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875634154535168:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788744435.063165:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788744435.063201:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875634154535168:12345-0@lo:400:kworker.0 Request processed in 42us (150us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788744435.063207:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788744435.063255:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788744435.063258:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788744435.063261:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788744435.063264:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744435.063267:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 232 00000100:00080000:3.0:1788744435.063273:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac776cf3800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744435.063285:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e92680 x1875634154535680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744435.063295:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154535168:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.063310:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154535552:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788744435.063339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744435.063375:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154535680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788744435.063393:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744435.063441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535552 00000100:00100000:2.0:1788744435.063445:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535552 00000100:00100000:2.0:1788744435.063463:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535680 00000100:00100000:2.0:1788744435.063466:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535680 00000100:00100000:2.0:1788744435.063478:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788744435.063492:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154535552:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788744435.063506:0:6517:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788744435.063568:0:7792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788744435.063573:0:7792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875634154535680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788744435.063581:0:7792:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788744435.063615:0:7792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875634154535680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40us (220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744435.063620:0:7792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788744435.063647:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744435.063652:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744435.063655:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154535680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788744435.069588:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788744435.069650:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788744435.069656:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788744435.069661:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788744435.069666:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744435.069696:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 213 00000100:00080000:1.0:1788744435.069709:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac642272800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744435.071158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535296 00000100:00100000:3.0:1788744435.071172:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535296 00000100:00100000:3.0:1788744435.071250:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788744435.071260:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154535296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744435.071332:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154535296:12345-0@lo:400:kworker.0 Request processed in 73us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744435.071354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:3.0:1788744435.071379:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744435.073878:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac644454a80 x1875634154535808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744435.073907:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154534784:0@lo:400:kworker.0 00010000:00080000:1.0:1788744435.073962:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643357100 x1875634154535296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744435.073973:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154535296:0@lo:400:kworker.0 00000100:00100000:3.0:1788744435.074100:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154535808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788744435.074164:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744435.074255:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535808 00000100:00100000:1.0:1788744435.074262:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535808 00000100:00100000:1.0:1788744435.074303:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788744435.074310:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154535808:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788744435.074328:0:6515:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788744435.074370:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154535808:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (207us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788744435.074377:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788744435.074506:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744435.074512:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744435.074515:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154535808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788744435.103584:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154535552:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40094us (40239us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744435.103599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788744435.103738:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775ba8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744435.103745:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744435.103749:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154535552:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788744435.105694:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ac775a47800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744435.105706:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1788744435.105721:0:3644:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ac775a47800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744435.106043:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac644544000 x1875634154535936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744435.106110:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154535936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788744435.106170:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744435.106257:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154534528:0@lo:400:kworker.0 00000100:00100000:2.0:1788744435.106627:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154535936 00000100:00100000:2.0:1788744435.106635:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154535936 00000100:00100000:2.0:1788744435.106692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788744435.106700:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875634154535936:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788744435.106716:0:6521:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788744435.106772:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875634154535936:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 72us (601us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744435.106780:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1788744435.106844:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775a47800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744435.106849:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744435.106853:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154535936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788744435.566852:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154536064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744435.566924:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744435.567346:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536064 00000100:00100000:3.0:1788744435.567355:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536064 00000100:00100000:3.0:1788744435.567426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788744435.567445:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154536064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788744435.567475:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788744435.567533:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154536064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744435.567540:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744435.567730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154536064:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788744436.078618:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744436.078924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154536192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744436.078991:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744436.079182:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536192 00000100:00100000:0.0:1788744436.079191:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536192 00000100:00100000:0.0:1788744436.079324:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744436.079335:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154536192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744436.079363:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788744436.079436:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154536192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744436.079443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788744436.079613:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154536192:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788744436.912534:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744437.103062:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744438.126681:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744439.151443:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744439.156045:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788744439.156053:0:6495:0:(genops.c:885:class_export_put()) final put ffff9ac774b03000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788744439.156125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac774b03000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788744439.156181:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac774b01800 for lustre-MDT0000 00000020:01000000:3.0:1788744439.854586:0:15147:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac64326be40 - data ffff9ac75d987a20/ffff9ac6431d3000 00000020:01000000:3.0:1788744439.855205:0:15147:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac7446cf7e0 - data ffff9ac75d872510/ffff9ac774a5f400 00000001:00000004:3.0:1788744439.866755:0:15147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788744439.928048:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788744439.928058:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788744439.928072:0:15147:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ac745070000 x1875634154534016/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788744443 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744439.928112:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788744439.933749:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788744439.933757:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788744439.933776:0:15147:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744439.933779:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788744439.934763:0:8964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788744439.934769:0:8964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788744439.934782:0:8964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788744439.939808:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788744439.939947:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788744439.939970:0:15147:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744439.939973:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788744439.940305:0:10034:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788744439.940310:0:10034:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788744439.940615:0:10034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788744439.942051:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbce4 00000020:00000080:3.0:1788744439.942063:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac751dc2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744439.944740:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbcf9 00000020:00000080:3.0:1788744439.944754:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac76e03a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788744439.944770:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788744439.944775:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744439.944782:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788744439.944787:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9ac7447299c0) has no exports 00000004:01000000:3.0:1788744439.944943:0:15147:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788744439.944951:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc12f 00000020:00000080:3.0:1788744439.944954:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac6436b1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788744439.944969:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788744439.944973:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744439.944982:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788744439.944984:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9ac64323cd40) has no exports 00000020:00000080:3.0:1788744439.944990:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc128 00000020:00000080:3.0:1788744439.944994:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac775a44800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788744439.945355:0:15147:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788744439.945360:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788744439.945364:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788744439.945370:0:15147:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744439.945372:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744439.945431:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744439.945439:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744439.945444:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbfed 00000020:00000080:3.0:1788744439.945448:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac7507fd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788744439.945452:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788744439.946872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac751dc2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788744439.946890:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac76e03a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788744439.946895:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6436b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788744439.946899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775a44800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788744439.946905:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac775a45800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788744439.946913:0:36:0:(genops.c:885:class_export_put()) final put ffff9ac77cadf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744439.946916:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77cadf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788744439.946920:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744439.947165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7507fd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788744439.947219:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744439.947230:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788744439.947235:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9ac77cdfcd40) has no exports 00000020:00000080:3.0:1788744439.947243:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbfe6 00000020:00000080:3.0:1788744439.947249:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac776cf4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788744439.947795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac776cf4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788744439.948299:0:15147:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788744439.948304:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788744439.948308:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788744439.948313:0:15147:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744439.948316:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744439.948713:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744439.948724:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788744439.948739:0:15147:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788744439.948745:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbeb2 00000020:00000080:3.0:1788744439.948753:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac775baa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744439.948866:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac776cf5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788744439.948874:0:36:0:(genops.c:885:class_export_put()) final put ffff9ac775e86000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744439.948886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775e86000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788744439.948892:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788744439.949123:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788744439.949128:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744439.949134:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788744439.949138:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9ac77c9b99c0) has no exports 00000020:00000080:3.0:1788744439.949145:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbeab 00000020:00000080:3.0:1788744439.949150:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac77c9e0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788744439.949166:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775baa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788744439.950975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c9e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788744439.967561:0:15147:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788744439.967569:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788744439.967573:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788744439.967581:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744439.967638:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744439.967659:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744439.967689:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744439.967727:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77c9e5800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788744439.967736:0:36:0:(genops.c:885:class_export_put()) final put ffff9ac77c9e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744439.967739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c9e4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788744439.967750:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744439.967903:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744439.967906:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac755645000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744439.967908:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac755645000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788744439.967915:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744439.968351:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd00 00000020:00000080:1.0:1788744439.968360:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac76e03a000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788744439.968375:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788744439.968379:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744439.968385:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744439.968388:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9ac74472b380) has no exports 00000020:00000080:0.0:1788744439.968486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac76e03a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788744439.968843:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744439.968849:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788744439.968853:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac76e03f000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788744439.968855:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac76e03f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788744439.968859:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788744439.968890:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd07 00000020:00000080:1.0:1788744439.968896:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac76e03d000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788744439.968907:0:15147:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac75196e800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788744439.968910:0:15147:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac75196e800 3 00000020:01000004:1.0:1788744439.968913:0:15147:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac75196e800 from lustre-MDT0000 00000020:00000080:1.0:1788744439.968933:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744439.968936:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788744439.968938:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac751dc6800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788744439.968940:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac751dc6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788744439.968948:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788744439.968985:0:15147:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788744439.968988:0:15147:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788744439.969002:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788744439.969005:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744439.969008:0:15147:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744439.969014:0:15147:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9ac7447db800 46c76a72-ee71-482d-9002-d7642a89bcb9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744439.969019:0:15147:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9ac750750000) has exports, disconnecting them 00000020:00080000:1.0:1788744439.969023:0:15147:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ac7447db800), last request at 1788744195 00000020:00000080:1.0:1788744439.969136:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbca5 00000020:00010000:1.0:1788744439.969140:0:15147:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ac7447db800: total 1 00000100:00080000:1.0:1788744439.969145:0:15147:0:(import.c:65:import_set_state_nolock()) ffff9ac7447df000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788744439.969159:0:15147:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac7447db800): rc 0 00000020:00080000:1.0:1788744439.969163:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9ac750750000) has no exports 00000020:00010000:1.0:1788744439.969173:0:6505:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ac7447db800: total 1 00010000:00010000:1.0:1788744439.969196:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ac7447db800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788744439.969221:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c5400/0xb6207a6e76dcbdaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcbda8 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969238:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac782170c00/0xb6207a6e76dcc446 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc43f expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969249:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83a00/0xb6207a6e76dcc1a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc19f expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969259:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcc454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc44d expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969269:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061a400/0xb6207a6e76dcc1b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc1ad expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969278:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcc462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc45b expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969302:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83e00/0xb6207a6e76dcc0c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc0bf expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969314:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b82200/0xb6207a6e76dcc216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc20f expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969323:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740030000/0xb6207a6e76dcc1d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc1c9 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969335:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac75e2c5e00/0xb6207a6e76dcc1c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc1bb expref: 5 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969345:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac76061a200/0xb6207a6e76dcbda1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcbd9a expref: 4 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969356:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac740031400/0xb6207a6e76dcc1de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc1d7 expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969366:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac775b83c00/0xb6207a6e76dcc1ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb6207a6e76dcc1e5 expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744439.969375:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ac7447db800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788744439.969388:0:6505:0:(genops.c:885:class_export_put()) final put ffff9ac7447db800/46c76a72-ee71-482d-9002-d7642a89bcb9 00010000:00010000:1.0:1788744439.969427:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744439.969429:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744439.969431:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744439.969551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac76e03d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788744439.969560:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7447db800/46c76a72-ee71-482d-9002-d7642a89bcb9 for MGS 00000020:00000080:0.0:1788744439.969599:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac7447df000 for MGS 00000100:00100000:1.0:1788744439.969930:0:6510:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ac761f7e400:6510] 1 exiting: rc = 0 00000100:00100000:0.0:1788744439.970208:0:6509:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ac74441aa00:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1788744439.970316:0:6511:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ac744da3a00:6511] 2 exiting: rc = 0 00000100:00100000:1.0:1788744439.970816:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970824:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970830:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970845:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970852:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970859:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970865:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970872:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970878:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970883:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970889:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970895:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970900:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970906:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970912:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970918:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970924:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970930:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970935:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970940:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970945:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.970950:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971022:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971099:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971105:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971111:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971117:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971123:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971129:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971134:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971140:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971145:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971151:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971156:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971161:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971166:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971171:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971176:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971188:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971194:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971201:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971207:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971213:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971218:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971223:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971229:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971234:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971239:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971244:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971249:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971254:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971260:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971265:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971269:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971274:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971279:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971283:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971287:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971293:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971298:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971303:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971308:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971312:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744439.971317:0:15147:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788744439.972301:0:15147:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac6433e8ae0 - data ffff9ac641c43000/ffff9ac643516400 00000020:01000000:1.0:1788744439.972446:0:15147:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac7500262a0 - data ffff9ac75d80eaf8/ffff9ac760086000 00000020:00000080:1.0:1788744439.974268:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbc89 00000020:00000080:1.0:1788744439.974279:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac748bd5800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788744439.974299:0:15147:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac75196e800 from MGS, refs=2 00000020:01000004:1.0:1788744439.974302:0:15147:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac75196e800 2 00000020:01000004:1.0:1788744439.974305:0:15147:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac75196e800 from MGS 00000020:00000080:1.0:1788744439.974325:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744439.974342:0:15147:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788744439.974346:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac751969000/MGS 00000020:00000080:1.0:1788744439.974348:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac751969000/MGS for MGS 00000020:01000000:1.0:1788744439.974356:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788744439.974437:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788744439.974441:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744439.974447:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00000080:0.0:1788744439.974556:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac748bd5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788744439.974633:0:15147:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ac774a26800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744439.974640:0:15147:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9ac774900000) has exports, disconnecting them 00000020:00080000:1.0:1788744439.974645:0:15147:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ac774a26800), last request at 1788744195 00000020:00000080:1.0:1788744439.974649:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd54 00000020:00080000:1.0:1788744439.974789:0:15147:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac774a26800): rc 0 00000020:00000080:1.0:1788744439.974794:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac774a26800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788744439.975098:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac774a26800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788744439.978475:0:15147:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788744439.978483:0:15147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744439.978487:0:15147:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744439.978493:0:15147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744439.978520:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac774a23000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788744439.978662:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744439.978678:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788744439.978682:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac774a22000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788744439.978685:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac774a22000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788744439.978690:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788744439.978761:0:15147:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac75196e800 1 00000020:00000080:0.0:1788744439.978766:0:15147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbc7b 00000020:00000080:0.0:1788744439.978772:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac75e2f9000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788744439.978779:0:15147:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788744439.978785:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac75e2f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788744439.978792:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744439.978795:0:15147:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788744439.978798:0:15147:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9ac74472cd40) has no exports 00000020:00000080:0.0:1788744440.115236:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744440.115249:0:15147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788744440.115254:0:15147:0:(genops.c:885:class_export_put()) final put ffff9ac75196b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788744440.115258:0:15147:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac75196b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788744440.115264:0:15147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788744440.115373:0:15147:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac751968800 00000020:02000400:0.0:1788744440.115521:0:15147:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788744440.177148:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744440.181134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744440.181140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744440.181144:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac775a47800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744440.181152:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 416 00000100:00080000:0.0:1788744440.181159:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788744440.181169:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ac775a47800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744440.181193:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f0700 x1875634154536448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744440.181208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744440.181221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744440.181222:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac775ba8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744440.181226:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 416 00000100:00080000:0.0:1788744440.181229:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788744440.181233:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ac775ba8000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744440.181246:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f1c00 x1875634154536576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744440.181255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744440.181259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744440.181260:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744440.181263:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 416 00000100:00080000:0.0:1788744440.181265:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788744440.181270:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac642272800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744440.181281:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f0a80 x1875634154536704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744440.181314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744440.181317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744440.181318:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744440.181321:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 416 00000100:00080000:0.0:1788744440.181324:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788744440.181328:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac776cf3800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744440.181340:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f1180 x1875634154537088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744440.181382:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154536320:0@lo:400:kworker.0 00000400:00000100:0.0:1788744440.181472:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634154536320 offset 0 length 224: 4 00000100:00100000:0.0:1788744440.181514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154537344:0@lo:400:kworker.0 00000100:00100000:0.0:1788744440.181545:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744440.181574:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744440.181581:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154537216:0@lo:400:kworker.0 00000100:00100000:0.0:1788744440.181605:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744440.181633:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154536832:0@lo:400:kworker.0 00000100:00100000:0.0:1788744440.181667:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744440.181687:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744440.181693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154536960:0@lo:400:kworker.0 00000100:00100000:0.0:1788744440.181713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744440.181746:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537344 00000100:00100000:0.0:1788744440.181753:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537344 00000100:00100000:3.0:1788744440.181785:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537216 00000100:00100000:3.0:1788744440.181789:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537216 00000100:00100000:0.0:1788744440.181795:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536960 00000100:00100000:0.0:1788744440.181797:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536960 00000100:00100000:3.0:1788744440.181826:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536832 00000100:00100000:3.0:1788744440.181829:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536832 00000100:00100000:3.0:1788744440.181863:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788744440.181872:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154537216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744440.181933:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154537216:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744440.181940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788744440.181956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788744440.181963:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154536832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744440.181996:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154536832:12345-0@lo:400:kworker.0 Request processed in 34us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744440.182007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:3.0:1788744440.182026:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744440.182030:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744440.182032:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788744440.182067:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ac6435f1f80 x1875634154536832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744440.182081:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154536832:0@lo:400:kworker.0 00010000:00080000:3.0:1788744440.182122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ac6435f2d80 x1875634154537216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744440.182130:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154537216:0@lo:400:kworker.0 00000100:00100000:1.0:1788744440.182551:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154536448:0@lo:38:kworker.0 00000100:00100000:1.0:1788744440.182587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744440.182620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154536576:0@lo:38:kworker.0 00000100:00100000:1.0:1788744440.182643:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744440.182673:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154536704:0@lo:38:kworker.0 00000100:00100000:1.0:1788744440.182694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744440.182718:0:7973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536448 00000100:00100000:1.0:1788744440.182723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154537088:0@lo:38:kworker.0 00000100:00100000:3.0:1788744440.182725:0:7973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536448 00000100:00100000:1.0:1788744440.182753:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744440.182759:0:7973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788744440.182766:0:7973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875634154536448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788744440.182785:0:7973:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788744440.182787:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536576 00000100:00100000:1.0:1788744440.182792:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536576 00000100:00100000:1.0:1788744440.182815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154536704 00000100:00100000:1.0:1788744440.182818:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154536704 00000100:00100000:1.0:1788744440.182827:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537088 00000100:00100000:1.0:1788744440.182829:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537088 00000100:00100000:3.0:1788744440.182840:0:7973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875634154536448:12345-0@lo:38:kworker.0 Request processed in 72us (251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788744440.182842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788744440.182847:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154536576:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788744440.182860:0:7973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00020000:1.0:1788744440.182871:0:6515:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788744440.182900:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154536576:12345-0@lo:38:kworker.0 Request processed in 52us (256us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788744440.182907:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788744440.182920:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788744440.182924:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154536704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788744440.182933:0:6515:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788744440.182953:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154536704:12345-0@lo:38:kworker.0 Request processed in 27us (258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788744440.182958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788744440.182969:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788744440.182972:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154537088:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788744440.182980:0:6515:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788744440.183001:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154537088:12345-0@lo:38:kworker.0 Request processed in 27us (249us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788744440.183007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1788744440.183042:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775a47800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744440.183047:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744440.183050:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154536448:0@lo:38:kworker.0 00000100:00080000:1.0:1788744440.183057:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775ba8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744440.183059:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744440.183062:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154536576:0@lo:38:kworker.0 00000100:00080000:1.0:1788744440.183069:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744440.183072:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744440.183081:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154536704:0@lo:38:kworker.0 00000100:00080000:1.0:1788744440.183091:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744440.183094:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744440.183097:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154537088:0@lo:38:kworker.0 00000100:00100000:0.0:1788744440.183170:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788744440.183182:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154537344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744440.183220:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154537344:12345-0@lo:400:kworker.0 Request processed in 43us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744440.183229:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788744440.183240:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154536960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744440.183291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154537344:0@lo:400:kworker.0 00000100:00100000:1.0:1788744440.183421:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154536960:12345-0@lo:400:kworker.0 Request processed in 162us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744440.185576:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154536960:0@lo:400:kworker.0 00000100:00100000:0.0:1788744440.185755:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788744440.191155:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788744440.687757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154537472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744440.687902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744440.688002:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537472 00000100:00100000:1.0:1788744440.688009:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537472 00000100:00100000:1.0:1788744440.688055:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788744440.688065:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154537472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744440.688093:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788744440.692222:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154537472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4143us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744440.692238:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788744440.694559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154537472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744441.200398:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154537600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744441.200479:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744441.200629:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537600 00000100:00100000:1.0:1788744441.200638:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537600 00000100:00100000:1.0:1788744441.200920:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788744441.200930:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154537600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744441.200959:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788744441.201006:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154537600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.201013:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00010000:3.0:1788744441.203441:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744441.203764:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154537600:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788744442.222787:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788744443.139586:0:15348:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788744443.155598:0:15348:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788744443.155664:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.155680:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.155687:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.155693:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.155710:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744443.155715:0:15348:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788744443.155740:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744443.155757:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788744443.155764:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788744443.155770:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9ac775ba8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788744443.155776:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744443.155777:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788744443.155780:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788744443.156119:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744443.156126:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.156135:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c4800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744443.156138:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.156147:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744443.156155:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744443.156160:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744443.156163:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788744443.156165:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788744443.156199:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.156206:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788744443.156380:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788744443.157074:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.157095:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c4800/0xb6207a6e76dcc1d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1de expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.157109:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744443.157111:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744443.157113:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744443.157459:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157469:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157476:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157483:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157500:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744443.157506:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157513:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157518:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157524:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157549:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788744443.157556:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157563:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157569:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157575:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157585:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788744443.157590:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157597:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157603:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157609:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.157615:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788744443.157618:0:15348:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788744443.157658:0:15348:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788744443.157661:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788744443.157666:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744443.157671:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788744443.157677:0:15348:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9ac77f753000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744443.157682:0:15348:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9ac642274000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744443.157686:0:15348:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9ac77b98cd40) has exports, disconnecting them 00000020:00080000:2.0:1788744443.157691:0:15348:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ac77f753000), last request at 1788744440 00000020:00000080:2.0:1788744443.157697:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc087 00000100:00080000:2.0:1788744443.157712:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9ac77f754000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788744443.157759:0:15348:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac77f753000): rc 0 00000020:00000080:2.0:1788744443.157762:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77f753000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788744443.157774:0:15348:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ac642274000), last request at 1788744440 00000020:00000080:2.0:1788744443.157777:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbf61 00000100:00080000:2.0:1788744443.157783:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9ac642273000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788744443.157790:0:15348:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac642274000): rc 0 00000020:00000080:2.0:1788744443.157792:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac642274000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788744443.157798:0:15348:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa7f9018abae0 00000100:00080000:2.0:1788744443.157814:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744443.157818:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788744443.158134:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788744443.158140:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.158148:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061aa00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744443.158152:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.158160:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744443.158167:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744443.158173:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744443.158175:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788744443.158177:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788744443.158204:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744443.158210:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1788744443.158883:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788744443.158889:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9ac775a47800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788744443.159929:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788744443.159935:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788744443.160033:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744443.160087:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788744443.160108:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9ac7507f8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788744443.160130:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788744443.160141:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:2.0:1788744443.160152:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744443.160207:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788744443.160217:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9ac6426d5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788744443.160241:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9ac77b98cd40) has no exports 00010000:00010000:2.0:1788744443.160878:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744443.160886:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.160896:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac75e2c5000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744443.160900:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.160910:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744443.160916:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744443.160921:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744443.160923:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788744443.160926:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788744443.160952:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.160959:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788744443.161132:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154537984:0@lo:9:umount.0 00000100:00100000:1.0:1788744443.161206:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744443.161259:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154538112:0@lo:9:umount.0 00000100:00100000:1.0:1788744443.161281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744443.161372:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1788744443.161547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77f753000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:2.0:1788744443.161657:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161666:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac75e2c5000/0xb6207a6e76dcc0bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc0c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161697:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744443.161701:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161706:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744443.161710:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161718:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744443.161724:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744443.161730:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744443.161732:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788744443.161734:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788744443.161753:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161759:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744443.161766:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161767:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161786:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcbda8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcbdaf expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161802:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744443.161803:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061aa00/0xb6207a6e76dcc1e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc1ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744443.161806:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744443.161816:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744443.161817:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744443.161821:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744443.161823:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744443.161829:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154538368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744443.161843:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154538240:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788744443.161908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac642274000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788744443.161930:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac77f754000 for lustre-MDT0001 00000020:00000080:1.0:1788744443.161935:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac642273000 for lustre-MDT0001 00000100:00100000:1.0:1788744443.161948:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154537856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744443.161984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744443.162032:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154538240 00000100:00100000:3.0:1788744443.162040:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154538240 00000100:00100000:3.0:1788744443.162277:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744443.162285:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875634154538240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788744443.162292:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744443 with bad export cookie 13123623929016794277 00000100:00100000:1.0:1788744443.162809:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744443.162835:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154537728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744443.162859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744443.163379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744443.163584:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744443.163593:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744443.163602:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744443.163606:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744443.163614:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744443.163646:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744443.163651:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788744443.163654:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788744443.163657:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788744443.163684:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744443.163691:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744443.163704:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744443.163710:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac774b58000/0xb6207a6e76dcc45b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb6207a6e76dcc462 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744443.163722:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744443.163723:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744443.163725:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744443.163733:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744443.163742:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154538496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744443.163771:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744443.163788:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744443.163790:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744443.163831:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537984 00000100:00100000:1.0:1788744443.163836:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537984 00000100:00100000:1.0:1788744443.163875:0:8966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154538112 00000100:00100000:1.0:1788744443.163878:0:8966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154538112 00000100:00100000:1.0:1788744443.163899:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744443.163907:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875634154537984:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744443.163935:0:8966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbfae 00000100:00080000:1.0:1788744443.163943:0:8966:0:(import.c:65:import_set_state_nolock()) ffff9ac641b56000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744443.164754:0:8966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788744443.164903:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3642:x1875634154537984:12345-0@lo:9:umount.0 Request processed in 995us (3696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744443.164911:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744443.164930:0:8966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788744443.164938:0:8966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875634154538112:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744443.164954:0:8966:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc0f0 00000100:00080000:1.0:1788744443.164961:0:8966:0:(import.c:65:import_set_state_nolock()) ffff9ac6427de000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744443.165055:0:8966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788744443.165135:0:8966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3642:x1875634154538112:12345-0@lo:9:umount.0 Request processed in 198us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744443.165142:0:8966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788744443.165191:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac7507f8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788744443.165273:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537856 00000100:00100000:0.0:1788744443.165279:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537856 00000100:00100000:0.0:1788744443.165317:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154537728 00000100:00100000:0.0:1788744443.165323:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154537728 00000100:00100000:0.0:1788744443.165337:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154538368 00000100:00100000:0.0:1788744443.165342:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154538368 00000100:00100000:0.0:1788744443.165352:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154538496 00000100:00100000:0.0:1788744443.165355:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154538496 00000100:00100000:0.0:1788744443.165364:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744443.165369:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875634154537856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788744443.165375:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744443 with bad export cookie 13123623929016794277 00000100:00100000:0.0:1788744443.165429:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875634154537856:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (2620us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744443.165435:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744443.165448:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744443.165452:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875634154537728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788744443.165456:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744443 with bad export cookie 13123623929016794277 00000100:00100000:0.0:1788744443.165481:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875634154537728:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (2621us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744443.165486:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744443.165498:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744443.165501:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77aa6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875634154538368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788744443.165505:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744443 with bad export cookie 13123623929016794277 00000100:00100000:0.0:1788744443.165534:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77aa6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875634154538368:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (2563us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744443.165540:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744443.165578:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744443.165583:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875634154538496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788744443.165588:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744443 with bad export cookie 13123623929016794277 00000100:00100000:0.0:1788744443.165619:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875634154538496:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (1848us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744443.165625:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788744443.165663:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788744443.165666:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788744443.165670:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000004:00080000:1.0:1788744443.165888:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744443.165891:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744443.165896:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154537984:0@lo:9:umount.0 00000100:00080000:1.0:1788744443.165915:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac6426d5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744443.165924:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744443.165926:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744443.165929:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154538112:0@lo:9:umount.0 00000100:00080000:1.0:1788744443.166075:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788744443.186653:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744443.186660:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744443.186789:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744443.186873:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875634154538240:12345-0@lo:103:ldlm_bl.0 Request processed in 24583us (24885us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788744443.186884:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788744443.186928:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1788744443.188576:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744443.203286:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788744443.203291:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788744443.203300:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643fb3b80 x1875634154536320/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788744456 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744443.203315:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643355f80 x1875634154538368/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744459 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744443.203323:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643355c00 x1875634154538240/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744459 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744443.203332:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e90700 x1875634154537856/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744443.203339:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e93480 x1875634154537728/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744443.203346:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e45500 x1875634154538496/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744459 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788744443.203355:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ac7603af800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1788744443.203360:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788744443.203362:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788744443.203363:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788744443.203367:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744443.203371:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 177 00000100:00080000:0.0:1788744443.203384:0:3646:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff9ac7603af800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744443.203535:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46c76a72-ee71-482d-9002-d7642a89bcb9:3644:1875634154538368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744443.203603:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e45880 x1875634154538624/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744443.203663:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154537856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744443.203670:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154537728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744443.203670:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154538624:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:1.0:1788744443.203678:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154536320:0@lo:400:kworker.0 00000100:00100000:1.0:1788744443.203696:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46c76a72-ee71-482d-9002-d7642a89bcb9:3646:1875634154538496:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788744443.203720:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634154538624 offset 0 length 520: 4 00000100:00080000:3.0:1788744443.204229:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ac7603af800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788744443.204241:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46c76a72-ee71-482d-9002-d7642a89bcb9:3643:1875634154538240:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788744443.208159:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9ac77b98cd40) has no exports 00000020:01000000:2.0:1788744443.248954:0:15348:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac642466ba0 - data ffff9ac75d9b80d8/ffff9ac643348400 00000020:01000000:2.0:1788744443.249104:0:15348:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac77ca4b6c0 - data ffff9ac75d8af510/ffff9ac780887000 00010000:00010000:1.0:1788744443.250043:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788744443.261680:0:15348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1788744443.317990:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788744443.317999:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788744443.318006:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788744443.319976:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788744443.319983:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788744443.320007:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744443.320009:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788744443.322050:0:8956:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788744443.322058:0:8956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788744443.322082:0:8956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788744443.323934:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788744443.323941:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:1.0:1788744443.323957:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744443.323960:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788744443.327488:0:10029:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788744443.327495:0:10029:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1788744443.327511:0:10029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788744443.328755:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbdcb 00000020:00000080:1.0:1788744443.328764:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77b986000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744443.329153:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77b986000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788744443.331763:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbde0 00000020:00000080:1.0:1788744443.331777:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77b985000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788744443.331791:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788744443.331797:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744443.331806:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744443.331810:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9ac7507519c0) has no exports 00000004:01000000:1.0:1788744443.331962:0:15348:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788744443.331970:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc0e9 00000020:00000080:1.0:1788744443.331974:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77f752800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788744443.331987:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788744443.331990:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744443.331997:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744443.332000:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9ac77c9bb380) has no exports 00000020:00000080:1.0:1788744443.332005:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc0e2 00000020:00000080:1.0:1788744443.332009:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac6426d2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744443.332483:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77b985000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788744443.332494:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77f752800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788744443.332498:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6426d2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788744443.332840:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788744443.332845:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788744443.332861:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:1.0:1788744443.332867:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744443.332869:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744443.332912:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744443.332922:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744443.332928:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbfa7 00000020:00000080:1.0:1788744443.332934:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac750727000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788744443.332938:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788744443.332942:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744443.332945:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744443.332948:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9ac77b98b380) has no exports 00000020:00000080:1.0:1788744443.332952:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbfa0 00000020:00000080:1.0:1788744443.332955:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac7507ff800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744443.333003:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6426d5000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788744443.333014:0:475:0:(genops.c:885:class_export_put()) final put ffff9ac77f752000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744443.333016:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77f752000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788744443.333023:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744443.333120:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac750727000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788744443.333127:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7507ff800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788744443.333954:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788744443.333959:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788744443.333962:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788744443.333968:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744443.333970:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744443.334016:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744443.334025:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788744443.334040:0:15348:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788744443.334046:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbe03 00000020:00000080:1.0:1788744443.334053:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac750726000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788744443.334059:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788744443.334071:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744443.334076:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744443.334079:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9ac77aaa8000) has no exports 00000020:00000080:1.0:1788744443.334083:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbdfc 00000020:00000080:1.0:1788744443.334086:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac775a42800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744443.334151:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac7507f8000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788744443.334160:0:475:0:(genops.c:885:class_export_put()) final put ffff9ac642271800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744443.334164:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac642271800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788744443.334172:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744443.334225:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac750726000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788744443.334229:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775a42800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788744443.411541:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788744443.411550:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744443.411555:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788744443.411563:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788744443.411636:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744443.411651:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788744443.411686:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744443.411689:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788744443.411695:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac7602d5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788744443.411700:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7602d5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788744443.411711:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788744443.411888:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbde7 00000020:00000080:2.0:1788744443.411895:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77b984800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788744443.411900:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788744443.411904:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744443.411909:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788744443.411913:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9ac77b9899c0) has no exports 00000020:00000080:2.0:1788744443.411934:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744443.411937:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788744443.411941:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbdee 00000020:00000080:2.0:1788744443.411955:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77b985800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788744443.411963:0:15348:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac774b65800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788744443.411966:0:15348:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac774b65800 2 00000020:01000004:2.0:1788744443.411969:0:15348:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac774b65800 from lustre-MDT0001 00000020:00000080:2.0:1788744443.411987:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744443.411990:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788744443.411993:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77b980000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788744443.411994:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77b980000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788744443.412003:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788744443.412035:0:15348:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788744443.412038:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788744443.412041:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744443.412044:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744443.412050:0:15348:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ac77c943800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744443.412055:0:15348:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9ac77aaab380) has exports, disconnecting them 00000020:00080000:2.0:1788744443.412059:0:15348:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ac77c943800), last request at 1788744213 00000020:00000080:2.0:1788744443.412062:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbe42 00000020:00080000:2.0:1788744443.412084:0:15348:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac77c943800): rc 0 00000020:00000080:2.0:1788744443.412088:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac77c943800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788744443.412763:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac775a47800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788744443.412771:0:475:0:(genops.c:885:class_export_put()) final put ffff9ac775a43800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744443.412773:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775a43800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788744443.412782:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744443.412874:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77b984800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788744443.412877:0:475:0:(genops.c:885:class_export_put()) final put ffff9ac77b981000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788744443.412879:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77b981000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788744443.412883:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788744443.413054:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77b985800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788744443.413060:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c943800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788744443.420484:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788744443.420514:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744443.420518:0:15348:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788744443.420526:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744443.420560:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac775ba8000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788744443.420756:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744443.420765:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788744443.420770:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac775bad800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788744443.420774:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775bad800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788744443.420780:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788744443.420844:0:15348:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac774b65800 1 00000020:00000080:3.0:1788744443.420850:0:15348:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbd7e 00000020:00000080:3.0:1788744443.420856:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac7602d2800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788744443.420864:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788744443.420872:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7602d2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788744443.420882:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744443.420886:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744443.420890:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9ac750754d40) has no exports 00000020:00000080:2.0:1788744443.519293:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744443.519307:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788744443.519313:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac774b60000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788744443.519317:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac774b60000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788744443.519328:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788744443.519469:0:15348:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac774b67800 00000020:01000000:2.0:1788744443.519488:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788744443.519493:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744443.519496:0:15348:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788744443.519500:0:15348:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9ac77aaa99c0) has no exports 00000100:00100000:1.0:1788744443.522134:0:6515:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9ac75dd7cc00:6515] 0 exiting: rc = 1 00000100:00100000:1.0:1788744443.522246:0:6516:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9ac75dd7aa00:6516] 1 exiting: rc = 0 00000100:00100000:1.0:1788744443.522314:0:7792:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9ac77c90e000:7792] 3 exiting: rc = 0 00000100:00100000:1.0:1788744443.522439:0:10509:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9ac6434f3600:10509] 4 exiting: rc = 0 00000100:00100000:2.0:1788744443.523296:0:6517:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9ac75dd7b600:6517] 2 exiting: rc = 0 00000100:00100000:0.0:1788744443.524049:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524059:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524064:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524070:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524077:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524084:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524089:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524095:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524108:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524116:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524121:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524126:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524132:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524138:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524143:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524149:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524155:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524160:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524165:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524170:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524175:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524180:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524187:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524192:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524198:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524204:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524210:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524216:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524221:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524226:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524231:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524236:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524254:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524259:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524263:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524269:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524274:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524279:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524284:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524289:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524294:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524300:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524305:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524311:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524317:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524322:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524328:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524333:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524339:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524345:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524350:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524355:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524360:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524365:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524370:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524375:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524380:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524386:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524391:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524396:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524460:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524468:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524473:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.524479:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744443.527336:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ac744721200:6519] 1 exiting: rc = 0 00000100:00100000:0.0:1788744443.527661:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ac7447e2c00:6518] 0 exiting: rc = 1 00000100:00100000:1.0:1788744443.527754:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527764:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527770:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527776:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527781:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527787:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527793:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527799:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527807:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527812:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527817:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527824:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527832:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527837:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527842:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527848:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527853:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527857:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527862:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527868:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527873:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527877:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527882:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527886:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527890:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527913:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527918:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527923:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527928:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527933:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527939:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527944:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527951:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527956:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527962:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527967:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527972:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527977:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527983:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527988:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527993:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.527999:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528004:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528009:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528013:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528018:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528022:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528027:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528031:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528036:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528041:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528045:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528049:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528054:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528060:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528065:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528069:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528075:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528080:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528084:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528097:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528101:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528107:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528112:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.528747:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9ac7447e2e00:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1788744443.528879:0:7973:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9ac775b6f600:7973] 2 exiting: rc = 0 00000100:00100000:0.0:1788744443.529487:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9ac744721000:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1788744443.529682:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529697:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529704:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529710:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529725:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529732:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529738:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529743:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529749:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529753:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529759:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529765:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529771:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529777:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529782:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529788:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529808:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529816:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529822:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529829:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529837:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529844:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529850:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529858:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529864:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529869:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529874:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529880:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529901:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529908:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529919:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529924:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529930:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529936:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529942:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529949:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529955:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529960:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529965:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529971:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529988:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529994:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.529999:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530005:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530010:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530016:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530021:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530026:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530031:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530036:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530042:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530048:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530064:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530071:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530077:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530082:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530089:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530094:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530100:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530105:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530112:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530118:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530124:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.530131:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744443.540157:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ac744f60a00:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1788744443.540267:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ac744f61e00:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1788744443.540396:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540819:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540824:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540829:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540834:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540839:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540844:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540849:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540854:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540858:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540862:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540867:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540872:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540876:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540881:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540885:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540890:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540895:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540900:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540905:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540910:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540916:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540921:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540925:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540929:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540934:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540938:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540944:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540949:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540955:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540959:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540964:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540968:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540975:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540980:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540984:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.540997:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541002:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541007:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541011:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541015:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541020:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541025:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541030:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541034:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541040:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541045:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541049:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541054:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541058:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541062:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541067:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541071:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541076:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541080:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541085:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541090:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541094:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541100:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541105:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541110:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541115:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541120:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.541126:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744443.541833:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ac744f60e00:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1788744443.542053:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ac744f61200:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1788744443.542102:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542108:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542113:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542118:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542123:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542128:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542133:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542138:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542144:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542148:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542153:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542158:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542163:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542168:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542172:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542177:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542183:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542189:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542194:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542198:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542203:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542208:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542213:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542218:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542223:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542227:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542232:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542237:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542242:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542247:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542252:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542257:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542262:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542266:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542280:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542285:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542290:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542295:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542300:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542305:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542310:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542315:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542319:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542324:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542329:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542334:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542339:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542344:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542349:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542354:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542359:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542365:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542370:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542375:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542381:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542385:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542391:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542396:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542472:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542479:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542484:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542490:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542495:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.542499:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744443.542919:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ac744f61c00:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788744443.543259:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ac744f61000:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1788744443.543304:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543310:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543315:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543320:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543333:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543338:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543343:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543349:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543353:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543359:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543364:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543370:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543375:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543380:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543385:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543389:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543395:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543661:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543670:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543675:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543681:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543686:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543691:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543697:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543702:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543706:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543711:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543716:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543721:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543726:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543730:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543736:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543741:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543746:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543750:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543755:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543761:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543766:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543771:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543783:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543788:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543793:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543799:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543803:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543808:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543813:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543818:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543822:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543827:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543832:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543837:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543841:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543846:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543850:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543856:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543861:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543865:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543869:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543874:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543878:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543883:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543887:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543892:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744443.543897:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744443.544774:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9ac7447f7000:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1788744443.545081:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9ac7447f7c00:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1788744443.545784:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9ac7447f7e00:6530] 2 exiting: rc = 0 00000100:00100000:1.0:1788744443.546016:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546024:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546030:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546035:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546049:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546055:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546071:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546076:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546082:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546087:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546092:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546097:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546103:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546108:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546113:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546120:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546127:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546132:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546137:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546142:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546147:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546167:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546174:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546179:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546184:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546189:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546195:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546201:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546207:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546213:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546218:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546224:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546230:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546235:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546241:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546246:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546252:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546257:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546262:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546268:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546274:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546286:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546291:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546298:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546304:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546325:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546332:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546337:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546342:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546348:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546353:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546358:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546365:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546371:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546376:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546381:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546387:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546393:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546399:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546425:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546431:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546438:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546444:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744443.546451:0:15348:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788744443.549992:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744443.550006:0:15348:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788744443.550012:0:15348:0:(genops.c:885:class_export_put()) final put ffff9ac751dc3800/MDS_uuid 00000020:00000080:1.0:1788744443.550016:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac751dc3800/MDS_uuid for MDS 00000020:01000000:1.0:1788744443.550022:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788744443.550151:0:15348:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788744444.271634:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744445.294609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744445.294626:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744445.294629:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744445.294651:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788744445.294655:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744445.294663:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1788744445.294669:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744445.294682:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac642272800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744445.294719:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e45500 x1875634154538752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744445.294765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744445.294769:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788744445.294770:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744445.294774:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1788744445.294777:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744445.294781:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac776cf3800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744445.294793:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e47b80 x1875634154539008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744445.294840:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154538880:0@lo:400:kworker.0 00000400:00000100:1.0:1788744445.294882:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154538880 offset 0 length 224: 4 00000100:00100000:1.0:1788744445.294946:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744445.294952:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154539136:0@lo:400:kworker.0 00000400:00000100:1.0:1788744445.294985:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539136 offset 0 length 224: 4 00010000:00010000:3.0:1788744445.295188:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744445.295332:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154538752:0@lo:38:kworker.0 00000400:00000100:2.0:1788744445.295358:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154538752 offset 0 length 520: 4 00000100:00100000:2.0:1788744445.295373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154539008:0@lo:38:kworker.0 00000400:00000100:2.0:1788744445.295389:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539008 offset 0 length 520: 4 00010000:00010000:3.0:1788744446.320572:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788744446.949085:0:15549:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788744446.966093:0:15549:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788744446.966146:0:15549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744446.966161:0:15549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744446.966169:0:15549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744446.966177:0:15549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744446.966198:0:15549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744446.966204:0:15549:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788744446.966226:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744446.966237:0:15549:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e45500 x1875634154538752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744465 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744446.966256:0:15549:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788744446.966263:0:15549:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788744446.966269:0:15549:0:(import.c:65:import_set_state_nolock()) ffff9ac642272800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788744446.966274:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744446.966278:0:15549:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e45500 x1875634154538752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744465 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744446.966286:0:15549:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788744446.966289:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1788744446.966513:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744446.966520:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744446.966529:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061ac00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744446.966544:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744446.966552:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744446.966560:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744446.966564:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744446.966566:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788744446.966569:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788744446.966580:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:1.0:1788744446.966584:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744446.966590:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061ac00/0xb6207a6e76dcc1bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1c2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744446.966599:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744446.966601:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744446.966603:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744446.966933:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154538752:0@lo:38:kworker.0 00000100:00080000:0.0:1788744446.968600:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788744446.968623:0:15549:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e44380 x1875634154538880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744446.968720:0:15549:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788744446.968727:0:15549:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788744446.968753:0:15549:0:(import.c:65:import_set_state_nolock()) ffff9ac641b55000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788744446.968886:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875634154539264:0@lo:39:umount.0 00000400:00000100:3.0:1788744446.968938:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539264 offset 0 length 224: 4 00000100:00100000:1.0:1788744446.969030:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154538880:0@lo:400:kworker.0 00010000:00010000:1.0:1788744447.344168:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744448.303556:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788744448.303566:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744448.303584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788744448.303588:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788744448.303715:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744448.303735:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154539392:0@lo:400:kworker.0 00000400:00000100:0.0:1788744448.303779:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539392 offset 0 length 224: 4 00010000:00010000:3.0:1788744448.366621:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744449.390765:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744449.394109:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788744449.394121:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ac641b57000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788744449.394309:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac641b57000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788744449.394363:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac641b56000 for lustre-OST0000 00000001:00100000:0.0:1788744449.397437:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788744449.397449:0:9507:0:(genops.c:885:class_export_put()) final put ffff9ac6427dc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744449.397568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6427dc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788744449.397634:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6427de000 for lustre-OST0001 00000100:00080000:0.0:1788744450.350566:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744450.350576:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744450.350579:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744450.350582:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744450.350755:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154539520:0@lo:400:kworker.0 00000400:00000100:1.0:1788744450.350810:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539520 offset 0 length 224: 4 00010000:00010000:1.0:1788744450.420103:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744451.438561:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744452.463106:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744453.103253:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744443/real 1788744443] req@ffff9ac643e45880 x1875634154538624/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788744453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744453.103287:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e45880 x1875634154538624/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788744453 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744453.103308:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744453.103334:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788744453.103339:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154538624:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788744453.103481:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744453.103486:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788744453.103490:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744453.103495:0:475:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1788744453.103500:0:475:0:(import.c:630:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744453.103510:0:475:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff9ac7603af800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744453.103541:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643355500 x1875634154539648/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744453.103577:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744453.103581:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744453.103741:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154539776:0@lo:400:kworker.0 00000400:00000100:1.0:1788744453.103801:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539776 offset 0 length 224: 4 00000100:00100000:3.0:1788744453.104680:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154539648:0@lo:250:kworker.0 00000400:00000100:3.0:1788744453.104713:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634154539648 offset 0 length 520: 4 00010000:00010000:3.0:1788744453.489800:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744454.510680:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744455.534750:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744456.174561:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744446/real 1788744446] req@ffff9ac6435f0e00 x1875634154539264/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744456 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744456.174593:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac6435f0e00 x1875634154539264/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744456 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744456.174613:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac641b55000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788744456.174635:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875634154539264:0@lo:39:umount.0 00000100:00080000:0.0:1788744456.174737:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788744456.174742:0:15549:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788744456.174747:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788744456.178656:0:15549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178675:0:15549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178683:0:15549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178709:0:15549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178735:0:15549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744456.178743:0:15549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178750:0:15549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178756:0:15549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178763:0:15549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.178785:0:15549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788744456.178790:0:15549:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788744456.178819:0:15549:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788744456.178823:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788744456.178828:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744456.178833:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788744456.178837:0:15549:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9ac774903380) has no exports 00000020:00080000:0.0:1788744456.178859:0:15549:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9ac774903380) has no exports 00010000:00010000:2.0:1788744456.180680:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744456.180693:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180704:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac76061a800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744456.180708:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180717:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744456.180724:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744456.180730:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744456.180733:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788744456.180735:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788744456.180752:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:2.0:1788744456.180772:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180779:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac76061a800/0xb6207a6e76dcc1c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180795:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744456.180799:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180805:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58600 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:2.0:1788744456.180807:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180814:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744456.180819:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744456.180825:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788744456.180827:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788744456.180829:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788744456.180835:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:2.0:1788744456.180838:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180844:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac774b58600/0xb6207a6e76dcc44d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc454 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.180853:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744456.180861:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744456.180863:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744456.180925:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788744456.183339:0:15549:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac6433e8240 - data ffff9ac641c110d8/ffff9ac643515400 00000020:01000000:1.0:1788744456.184650:0:15549:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac6424668a0 - data ffff9ac75dafcaf8/ffff9ac64237e400 00100000:10000000:2.0:1788744456.197952:0:15549:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788744456.210257:0:15549:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbf1b 00000020:00000080:2.0:1788744456.210270:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac750724000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788744456.210288:0:15549:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac77c9d5000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788744456.210292:0:15549:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac77c9d5000 2 00000020:01000004:2.0:1788744456.210297:0:15549:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac77c9d5000 from lustre-OST0000 00000020:00000080:1.0:1788744456.210304:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac750724000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788744456.210322:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744456.210332:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788744456.210336:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac775bac800/lustre-OST0000_UUID 00000020:00000080:2.0:1788744456.210338:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac775bac800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788744456.210345:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788744456.210393:0:15549:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788744456.210397:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788744456.210428:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744456.210434:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744456.210441:0:15549:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ac641b55800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744456.210447:0:15549:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9ac77b988000) has exports, disconnecting them 00000020:00080000:2.0:1788744456.210452:0:15549:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ac641b55800), last request at 1788744231 00000020:00000080:2.0:1788744456.210456:0:15549:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbf45 00000020:00080000:2.0:1788744456.210466:0:15549:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac641b55800): rc 0 00000020:00000080:2.0:1788744456.210471:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac641b55800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788744456.210505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac641b55800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788744456.216651:0:15549:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788744456.216659:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744456.216663:0:15549:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744456.216670:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744456.216746:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac642272800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788744456.216951:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744456.216959:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788744456.216964:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac642277000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788744456.216968:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac642277000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788744456.216978:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788744456.217037:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788744456.217041:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744456.217054:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788744456.217059:0:15549:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ac641b52000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744456.217065:0:15549:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9ac77c9b8000) has exports, disconnecting them 00000020:00080000:0.0:1788744456.217070:0:15549:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ac641b52000), last request at 1788744231 00000020:00000080:0.0:1788744456.217074:0:15549:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbf5a 00000020:00080000:0.0:1788744456.217087:0:15549:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac641b52000): rc 0 00000020:00000080:0.0:1788744456.217091:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac641b52000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788744456.217510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac641b52000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788744456.218446:0:15549:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788744456.218451:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788744456.218454:0:15549:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788744456.218460:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744456.218477:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac641b55000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788744456.218626:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744456.218632:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788744456.218636:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac641b53000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788744456.218638:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac641b53000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788744456.218642:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788744456.218697:0:15549:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac77c9d5000 1 00000020:00000080:1.0:1788744456.218701:0:15549:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbee3 00000020:00000080:1.0:1788744456.218706:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac77c9d6000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788744456.218713:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788744456.218719:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c9d6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788744456.218726:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744456.218729:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788744456.218732:0:15549:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9ac77aaacd40) has no exports 00000020:00000080:1.0:1788744456.255312:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744456.255326:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788744456.255340:0:15549:0:(genops.c:885:class_export_put()) final put ffff9ac77c9d0000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788744456.255345:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c9d0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788744456.255354:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788744456.255680:0:15549:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac77c9d7800 00000020:02000400:1.0:1788744456.255725:0:15549:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788744456.560614:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744457.588735:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744458.610545:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744458.610556:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744458.610559:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744458.610562:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744458.610761:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154539904:0@lo:400:kworker.0 00000400:00000100:2.0:1788744458.610821:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154539904 offset 0 length 224: 4 00010000:00010000:2.0:1788744458.620506:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744459.630926:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744459.664771:0:15751:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788744459.682641:0:15751:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788744459.682736:0:15751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744459.682749:0:15751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744459.682757:0:15751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744459.682764:0:15751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744459.682793:0:15751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788744459.682799:0:15751:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788744459.682824:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744459.682836:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e47b80 x1875634154539008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744465 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.682861:0:15751:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788744459.682868:0:15751:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788744459.682874:0:15751:0:(import.c:65:import_set_state_nolock()) ffff9ac776cf3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788744459.682879:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744459.682883:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e47b80 x1875634154539008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744465 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.682890:0:15751:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788744459.682908:0:15751:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788744459.683009:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154539008:0@lo:38:kworker.0 00010000:00010000:1.0:1788744459.683172:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744459.683179:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744459.683187:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031a00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744459.683191:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744459.683200:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744459.683208:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744459.683214:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744459.683216:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788744459.683219:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788744459.683231:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:1.0:1788744459.683235:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744459.683242:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740031a00/0xb6207a6e76dcc19f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744459.683252:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744459.683261:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744459.683263:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744459.684265:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788744459.684276:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e47480 x1875634154539136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.684297:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e90a80 x1875634154539392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744464 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.684310:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac6435f1880 x1875634154539520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744466 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.684323:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643354000 x1875634154539776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744469 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.684335:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643355880 x1875634154539904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744474 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744459.684342:0:15751:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788744459.684347:0:15751:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788744459.684368:0:15751:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788744459.684473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154539136:0@lo:400:kworker.0 00000100:00100000:0.0:1788744459.684617:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154539904:0@lo:400:kworker.0 00000100:00100000:0.0:1788744459.684625:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154539392:0@lo:400:kworker.0 00000100:00100000:0.0:1788744459.684660:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875634154540032:0@lo:39:umount.0 00000400:00000100:0.0:1788744459.684701:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634154540032 offset 0 length 224: 4 00000100:00100000:1.0:1788744459.684803:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154539520:0@lo:400:kworker.0 00000100:00100000:1.0:1788744459.684822:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154539776:0@lo:400:kworker.0 00010000:00010000:3.0:1788744460.660106:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744461.678988:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744462.702676:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744463.726649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:2.0:1788744463.726656:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744463.726659:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788744464.752600:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744465.774627:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744466.798696:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744467.822655:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744468.847075:0:15349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744468.847652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744468.847659:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744468.910542:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744453/real 1788744453] req@ffff9ac643355500 x1875634154539648/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788744468 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744468.910578:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643355500 x1875634154539648/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788744468 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744468.910595:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744468.910625:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788744468.910629:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154539648:0@lo:250:kworker.0 00000100:00080000:1.0:1788744468.910673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744468.910679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788744468.910682:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744468.910688:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788744468.910693:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744468.910704:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff9ac7603af800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744468.910733:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e44380 x1875634154540160/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744468.911039:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154540160:0@lo:250:kworker.0 00000400:00000100:2.0:1788744468.911084:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634154540160 offset 0 length 520: 4 00010000:00010000:2.0:1788744469.871996:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744469.934550:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744459/real 1788744459] req@ffff9ac643e91f80 x1875634154540032/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744469 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744469.934587:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e91f80 x1875634154540032/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744469 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744469.934608:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac6433cb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788744469.934633:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875634154540032:0@lo:39:umount.0 00000100:00080000:3.0:1788744469.934733:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788744469.934738:0:15751:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788744469.934743:0:15751:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788744469.935649:0:15751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935666:0:15751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935691:0:15751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935698:0:15751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935730:0:15751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744469.935739:0:15751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935746:0:15751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935752:0:15751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935758:0:15751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744469.935777:0:15751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788744469.935782:0:15751:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788744469.935818:0:15751:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788744469.935822:0:15751:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788744469.935837:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744469.935843:0:15751:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744469.935847:0:15751:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9ac77cdf99c0) has no exports 00000020:00080000:3.0:1788744469.935870:0:15751:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9ac77cdf99c0) has no exports 00000020:01000000:3.0:1788744469.937529:0:15751:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac6433e8ea0 - data ffff9ac75db711b0/ffff9ac77cdc2c00 00000020:01000000:3.0:1788744469.937649:0:15751:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ac6430f4120 - data ffff9ac75d9b9288/ffff9ac6431f4000 00010000:00010000:0.0:1788744469.938366:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744469.938377:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938388:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744469.938393:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938449:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744469.938466:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744469.938472:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744469.938475:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788744469.938478:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788744469.938494:0:9528:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:0.0:1788744469.938498:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938505:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac740030800/0xb6207a6e76dcc1ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc1b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938516:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744469.938520:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938525:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bfc00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744469.938528:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938535:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744469.938542:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744469.938557:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788744469.938559:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788744469.938561:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788744469.938568:0:9528:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:0.0:1788744469.938571:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938578:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcc43f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744469.938590:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744469.938591:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744469.938593:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744469.938646:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788744469.948505:0:15751:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788744469.970352:0:15751:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc041 00000020:00000080:2.0:1788744469.970362:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac6427de800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788744469.970379:0:15751:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac642271000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788744469.970383:0:15751:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac642271000 2 00000020:01000004:2.0:1788744469.970386:0:15751:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac642271000 from lustre-OST0001 00000020:00000080:2.0:1788744469.970438:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744469.970448:0:15751:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788744469.970463:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac77c9d3800/lustre-OST0001_UUID 00000020:00000080:2.0:1788744469.970466:0:15751:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c9d3800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788744469.970473:0:15751:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788744469.970672:0:15751:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 46c76a72-ee71-482d-9002-d7642a89bcb9->MGS 00010000:00010000:2.0:1788744469.970687:0:15751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcbd9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744469.970699:0:15751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcbd9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744469.970705:0:15751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788744469.970708:0:15751:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788744469.970711:0:15751:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788744469.970725:0:15751:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:2.0:1788744469.970729:0:15751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcbd9a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcbda1 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744469.970744:0:15751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744469.970751:0:15751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744469.970768:0:15751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744469.970771:0:15751:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 00000020:00000080:1.0:1788744469.970842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6427de800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1788744469.970924:0:15751:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788744469.970936:0:15751:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7603af800 00010000:00010000:2.0:1788744469.970990:0:15751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac775b83200/0xb6207a6e76dcc20f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb6207a6e76dcc216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744469.971012:0:15751:0:(import.c:65:import_set_state_nolock()) ffff9ac7603af800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788744469.971016:0:15751:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788744469.971018:0:15751:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788744469.971019:0:15751:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788744469.971024:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788744469.971033:0:15751:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac643e44380 x1875634154540160/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788744488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788744469.971052:0:15751:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744469.971055:0:15751:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1788744469.971375:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46c76a72-ee71-482d-9002-d7642a89bcb9:3642:1875634154540160:0@lo:250:kworker.0 10000000:01000000:2.0:1788744469.971997:0:15751:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744469.972007:0:15751:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcbc97 00000020:00000080:2.0:1788744469.972015:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac751dc3000/46c76a72-ee71-482d-9002-d7642a89bcb9 00000020:01000000:2.0:1788744469.972028:0:15751:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.104@tcp (flags='') 00000020:00000080:2.0:1788744469.972034:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744469.972040:0:15751:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788744469.972052:0:15751:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9ac750753380) has no exports 00000020:00000080:1.0:1788744469.972075:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac751dc3000/46c76a72-ee71-482d-9002-d7642a89bcb9 for MGC192.168.203.104@tcp 10000000:01000000:0.0:1788744469.972111:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788744469.972213:0:15751:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.104@tcp: client import never connected 00000100:00080000:2.0:1788744469.972217:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788744469.972219:0:15751:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744469.972221:0:15751:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788744469.972223:0:15751:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744469.972268:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744469.972274:0:15751:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.104@tcp (uuid 46c76a72-ee71-482d-9002-d7642a89bcb9) 00000020:01000000:2.0:1788744469.972279:0:15751:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788744469.972283:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744469.972285:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac7603af800 for MGC192.168.203.104@tcp 00000020:00000080:2.0:1788744469.972287:0:15751:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744469.972292:0:15751:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ac776cf6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788744469.972292:0:37:0:(genops.c:885:class_export_put()) final put ffff9ac7603aa000/46c76a72-ee71-482d-9002-d7642a89bcb9 00000020:00000080:1.0:1788744469.972294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac7603aa000/46c76a72-ee71-482d-9002-d7642a89bcb9 for MGC192.168.203.104@tcp 00000020:01000000:1.0:1788744469.972299:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.104@tcp (46c76a72-ee71-482d-9002-d7642a89bcb9) 00000020:00080000:2.0:1788744469.972307:0:15751:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9ac64323b380) has exports, disconnecting them 00000020:00080000:2.0:1788744469.972310:0:15751:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ac776cf6000), last request at 1788744251 00000020:00000080:2.0:1788744469.972314:0:15751:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc06b 00000020:00080000:2.0:1788744469.972326:0:15751:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac776cf6000): rc 0 00000020:00000080:2.0:1788744469.972329:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac776cf6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788744469.972769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac776cf6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788744470.001496:0:15751:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788744470.001506:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744470.001510:0:15751:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744470.001518:0:15751:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744470.001708:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744470.001716:0:15751:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788744470.001722:0:15751:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788744470.001726:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744470.001731:0:15751:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788744470.001738:0:15751:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ac6433ce800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744470.001745:0:15751:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9ac6433c0000) has exports, disconnecting them 00000020:00080000:0.0:1788744470.001750:0:15751:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ac6433ce800), last request at 1788744251 00000020:00000080:0.0:1788744470.001753:0:15751:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc080 00000020:00080000:0.0:1788744470.001777:0:15751:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac6433ce800): rc 0 00000020:00000080:0.0:1788744470.001782:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac6433ce800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788744470.002609:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac776cf3800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788744470.002619:0:37:0:(genops.c:885:class_export_put()) final put ffff9ac776cf1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788744470.002623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac776cf1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788744470.002633:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788744470.002701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433ce800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788744470.010467:0:15751:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788744470.010475:0:15751:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788744470.010480:0:15751:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788744470.010487:0:15751:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788744470.010523:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ac6433cb000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788744470.010575:0:15349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788744470.010713:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788744470.021001:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788744470.021287:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788744470.021425:0:6500:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ac75560bc00:6500] 1 exiting: rc = 0 00000100:00100000:1.0:1788744470.022272:0:6499:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ac75560a000:6499] 0 exiting: rc = 1 00000100:00100000:2.0:1788744470.022314:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.022624:0:6501:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ac7617ba600:6501] 0 exiting: rc = 1 00000100:00100000:2.0:1788744470.022702:0:6503:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ac7557bc600:6503] 2 exiting: rc = 0 00000100:00100000:2.0:1788744470.022758:0:9517:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ac77cbf3800:9517] 3 exiting: rc = 0 00000100:00100000:2.0:1788744470.022827:0:10333:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9ac77cbada00:10333] 4 exiting: rc = 0 00000100:00100000:1.0:1788744470.023217:0:6502:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ac7557bcc00:6502] 1 exiting: rc = 0 00000100:00100000:2.0:1788744470.023308:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023316:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023323:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023329:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023346:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023352:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023358:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023363:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023369:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023374:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023379:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023384:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023391:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023397:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023438:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023444:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023450:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023467:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023473:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023479:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023486:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023491:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023496:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023501:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023505:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023509:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023514:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023519:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023525:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023531:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023537:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023542:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023547:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023551:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023557:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023561:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023566:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023571:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023575:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023587:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023592:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023598:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023613:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023618:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023622:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023628:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023634:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023640:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023646:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023652:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023657:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023662:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023667:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023675:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023681:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023687:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023692:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023698:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023703:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023708:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023713:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023718:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023723:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.023727:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788744470.024633:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744470.024642:0:15751:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788744470.024648:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac6433ca000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788744470.024652:0:15751:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac6433ca000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788744470.024660:0:15751:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788744470.024707:0:15751:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac642271000 1 00000020:00000080:2.0:1788744470.024712:0:15751:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb6207a6e76dcc010 00000020:00000080:2.0:1788744470.024717:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac776cf3000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788744470.024734:0:15751:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788744470.024745:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744470.024750:0:15751:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788744470.024754:0:15751:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9ac774904d40) has no exports 00000020:00000080:1.0:1788744470.025129:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac776cf3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788744470.045102:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744470.045115:0:15751:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788744470.045121:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac642275000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788744470.045126:0:15751:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac642275000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788744470.045132:0:15751:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788744470.045857:0:15751:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac642273800 00000020:01000000:2.0:1788744470.045886:0:15751:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788744470.045892:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744470.045897:0:15751:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788744470.045901:0:15751:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9ac77cdfb380) has no exports 00000020:00000080:2.0:1788744470.045936:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744470.045943:0:15751:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788744470.045946:0:15751:0:(genops.c:885:class_export_put()) final put ffff9ac77c9d1000/OSS_uuid 00000020:00000080:2.0:1788744470.045949:0:15751:0:(genops.c:844:class_export_destroy()) destroying export ffff9ac77c9d1000/OSS_uuid for OSS 00000020:01000000:2.0:1788744470.045953:0:15751:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788744470.046162:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9ac774a3be00:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1788744470.046251:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9ac774bbd800:8431] 1 exiting: rc = 0 00000100:00080000:3.0:1788744470.046265:0:6512:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788744470.046295:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9ac77b87fa00:8432] 2 exiting: rc = 0 00000100:00100000:1.0:1788744470.046337:0:8966:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9ac77b859c00:8966] 3 exiting: rc = 0 00000100:00100000:2.0:1788744470.046451:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046527:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046534:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046540:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046546:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046551:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046556:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046561:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046565:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046570:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046574:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046578:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046583:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046589:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046595:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046600:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046629:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046634:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046639:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046644:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046649:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046655:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046660:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046665:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046671:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046676:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046680:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046685:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046690:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046695:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046699:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046705:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046710:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046715:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046721:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046726:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046731:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046737:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046741:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046746:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046751:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046755:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046760:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046765:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046771:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046777:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046783:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046788:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046793:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046799:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046804:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046817:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046823:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046828:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046833:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046838:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046843:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046848:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046853:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046858:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046864:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046869:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046874:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.046879:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744470.047934:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ac775b6fc00:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1788744470.048167:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ac77b86c800:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1788744470.048339:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048348:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048356:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048361:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048367:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048373:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048378:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048555:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048562:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048567:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048572:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048577:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048581:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048588:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048593:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048598:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048602:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048674:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048680:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048687:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048692:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048697:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048723:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048729:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048735:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048740:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048746:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048752:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048757:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048763:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048767:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048771:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048775:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048781:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048786:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048792:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048797:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048802:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048807:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048811:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048816:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048821:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048826:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048831:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048836:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048868:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048877:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048883:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048889:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048896:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048901:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048906:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048911:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048916:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048921:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048926:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048931:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048943:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048948:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048953:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048957:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048962:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048966:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.048977:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.052220:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ac77c912000:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1788744470.052283:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ac774a34a00:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1788744470.062051:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ac774a34e00:8436] 1 exiting: rc = 0 00000100:00100000:3.0:1788744470.065092:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065112:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065120:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065131:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065141:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065151:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065158:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065168:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065174:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.065180:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066413:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066431:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066441:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066449:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066468:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066475:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066480:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066487:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066494:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066501:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066520:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066531:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066540:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066551:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066561:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066572:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066581:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066611:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066618:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066623:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066641:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066647:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066653:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066658:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066664:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066671:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066679:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066690:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066699:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066710:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066721:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066730:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066742:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066754:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066766:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066776:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066786:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066796:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066806:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066822:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.066830:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067271:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067278:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067284:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067290:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067296:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067301:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067306:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067312:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067318:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067324:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067332:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067339:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744470.067356:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.082701:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ac7447f6800:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1788744470.082918:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ac77c912400:8438] 0 exiting: rc = 1 00000100:00100000:2.0:1788744470.083144:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083152:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083158:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083164:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083170:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083175:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083193:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083201:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083206:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083211:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083215:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083220:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083225:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083231:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083236:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083241:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083247:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083252:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083271:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083278:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083284:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083289:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083294:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083300:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083305:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083310:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083315:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083336:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083340:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083345:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083351:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083356:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083362:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083367:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083372:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083377:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083382:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083387:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083393:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083398:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083478:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083483:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083489:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083494:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083499:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083504:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083509:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083515:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083522:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083527:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083533:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083550:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083558:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083564:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083569:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083574:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083578:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083584:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083589:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083595:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.083600:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.084187:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.084202:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.084207:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744470.085332:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ac77c918800:8440] 0 exiting: rc = 1 00000100:00100000:2.0:1788744470.085575:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ac77c918000:8441] 1 exiting: rc = 0 00000100:00100000:2.0:1788744470.088221:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088234:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088242:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088248:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088266:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088275:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088281:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088287:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088294:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088300:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088307:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088314:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088337:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088345:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088352:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088359:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088366:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088374:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088380:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088385:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088394:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088428:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088436:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088442:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088475:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088483:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088491:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088497:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088502:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088508:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088514:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088520:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088543:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088549:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088555:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088562:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088584:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088592:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.088598:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089320:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089332:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089338:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089343:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089349:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089355:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089361:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089367:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089373:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089398:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089435:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089441:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089447:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089453:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089469:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089476:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089482:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089491:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089498:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089505:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089511:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089534:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089542:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089547:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744470.089553:0:15751:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788744470.113831:0:15751:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788744489.751892:0:16516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788744500.210223:0:17116:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744500.210241:0:17116:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788744500.210243:0:17116:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788744500.210372:0:17116:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ac641b52000 00000020:01000004:3.0:1788744500.210387:0:17116:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788744500.210394:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788744500.211662:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ac77cdfb380) 00000020:00000080:2.0:1788744500.211685:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788744500.321913:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788744500.324949:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788744500.330032:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788744500.331865:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788744500.332153:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788744500.332545:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788744500.332749:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788744500.333012:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788744500.333281:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788744500.333498:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788744500.333715:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788744500.334014:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788744500.334278:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788744500.338030:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788744500.339168:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788744500.339910:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.340321:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.341010:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.341334:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.342051:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.342354:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.342641:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.343954:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.344337:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.344665:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.344935:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.345274:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.345957:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.346362:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.346726:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788744500.348217:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.348732:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.349040:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788744500.349318:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788744500.351688:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.352137:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.352351:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.352641:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788744500.353141:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788744500.353961:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.354358:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.355041:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.355333:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.355807:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788744500.356474:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788744500.356923:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788744500.357140:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788744500.358685:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788744500.363022:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788744500.363454:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788744500.364137:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788744500.364941:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788744500.365217:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1788744500.366555:0:17116:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788744500.366780:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788744500.366788:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744500.366799:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd246 00000020:01000004:3.0:1788744500.366817:0:17116:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788744500.366832:0:17116:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788744500.366839:0:17116:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac641b52000 from MGS 00000020:01000004:3.0:1788744500.366843:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788744500.366854:0:17116:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ac6432399c0) 00000020:00000080:3.0:1788744500.366866:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788744500.366926:0:17116:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac641b52000 from MGS, refs=2 00080000:01000000:3.0:1788744500.366931:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788744500.366936:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd254 00000100:00100000:3.0:1788744500.367026:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788744500.367169:0:17116:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788744500.367175:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788744500.372534:0:17116:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788744500.372554:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788744500.374565:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744500.374734:0:17116:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788744500.374740:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788744500.377141:0:17116:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788744500.377158:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788744500.381512:0:17116:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788744500.381526:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788744500.388426:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744500.388441:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744500.388443:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744500.393328:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744500.393335:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744500.393338:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744500.394336:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788744500.397315:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788744500.413739:0:17116:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788744500.425180:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788744500.425256:0:17116:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788744500.425329:0:17116:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788744500.426388:0:17116:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788744500.427013:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744500.427722:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788744500.427730:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788744500.441447:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788744500.441460:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788744500.446627:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788744500.446641:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788744500.460170:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788744500.460200:0:17116:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:3.0:1788744500.460202:0:17116:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788744500.460233:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:3.0:1788744500.460246:0:17116:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (ffff9ac643238000) 00000020:00000080:3.0:1788744500.460271:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788744500.460353:0:17116:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac77cb33000@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744500.460544:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:3.0:1788744500.460550:0:17116:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788744500.466477:0:17133:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788744500.468211:0:17135:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788744500.468393:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid 3734829d-853b-494e-83d0-e0bd2808e668) 00000020:00000080:2.0:1788744500.468443:0:17116:0:(genops.c:1384:class_connect()) connect: client 3734829d-853b-494e-83d0-e0bd2808e668, cookie 0xb6207a6e76dcd262 00000100:00080000:2.0:1788744500.468456:0:17116:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744500.468469:0:17116:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff9ac77cb33000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744500.468505:0:17116:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643356300 x1875634154540288/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744500.468538:0:17116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3734829d-853b-494e-83d0-e0bd2808e668->MGS 00000020:01000004:2.0:1788744500.468564:0:17116:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788744500.468569:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788744500.468584:0:17116:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ac77cdf99c0) 00000020:00000080:2.0:1788744500.468597:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788744500.470246:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3734829d-853b-494e-83d0-e0bd2808e668:3642:1875634154540288:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788744500.470333:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744500.471197:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154540288 00000100:00100000:0.0:1788744500.471208:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154540288 00000100:00100000:0.0:1788744500.471245:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744500.471254:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875634154540288:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788744500.471293:0:17130:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 3734829d-853b-494e-83d0-e0bd2808e668@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1788744500.471324:0:17130:0:(genops.c:1384:class_connect()) connect: client 3734829d-853b-494e-83d0-e0bd2808e668, cookie 0xb6207a6e76dcd270 00000100:00080000:0.0:1788744500.471584:0:17130:0:(import.c:65:import_set_state_nolock()) ffff9ac643ebf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744500.471659:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+5:3642:x1875634154540288:12345-0@lo:250:mount.lustre.0 Request processed in 404us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.471667:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744500.471716:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788744500.471725:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1788744500.471732:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788744500.471737:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788744500.471741:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac77cb33000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788744500.471743:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788744500.471751:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788744500.471756:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3734829d-853b-494e-83d0-e0bd2808e668:3642:1875634154540288:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788744500.488951:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744500.489154:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744500.489161:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788744500.498943:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788744500.498964:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788744500.499843:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744500.499852:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788744500.501296:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744500.501621:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788744500.501628:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788744500.502318:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788744500.502326:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788744500.573603:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744500.573947:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788744500.573953:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788744500.575293:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788744500.575311:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788744500.576201:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744500.576381:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744500.576387:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788744500.577256:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744500.577296:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788744500.577853:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744500.578132:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744500.578138:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788744500.578768:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744500.578774:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788744500.579584:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744500.579728:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744500.579732:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788744500.580215:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744500.580221:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788744500.600254:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744500.600663:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744500.600672:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788744500.602155:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788744500.602169:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788744500.617195:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744500.617217:0:17116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788744500.624656:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788744500.624706:0:17116:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788744500.624713:0:17116:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788744500.624823:0:17116:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744500.624875:0:17116:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788744500.624879:0:17116:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744500.624881:0:17116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744500.624882:0:17116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744500.624884:0:17116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744500.624885:0:17116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744500.624887:0:17116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744500.624888:0:17116:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744500.624890:0:17116:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744500.624892:0:17116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744500.624893:0:17116:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744500.624896:0:17116:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788744500.624898:0:17116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744500.624899:0:17116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744500.624900:0:17116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744500.624907:0:17116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744500.624908:0:17116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744500.624909:0:17116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744500.624910:0:17116:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744500.624911:0:17116:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744500.624912:0:17116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744500.624913:0:17116:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744500.624938:0:17116:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744500.624958:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744500.626282:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.628397:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.638811:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154540416 00000100:00100000:2.0:1788744500.638828:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154540416 00000100:00100000:2.0:1788744500.638906:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744500.638917:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+5:17116:x1875634154540416:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788744500.639188:0:17132:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788744500.639192:0:17132:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788744500.639196:0:17132:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788744500.639970:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788744500.640848:0:17132:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788744500.651570:0:17154:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788744500.651579:0:17154:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788744500.651583:0:17154:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788744500.651586:0:17154:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788744500.651799:0:17154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788744500.659938:0:17132:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744500.659952:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788744500.665933:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+5:17116:x1875634154540416:12345-0@lo:253:mount.lustre.0 Request processed in 27009us (39646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.665949:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744500.668593:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744500.668614:0:17116:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744500.668618:0:17116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744500.668620:0:17116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744500.668622:0:17116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744500.668623:0:17116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744500.668624:0:17116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744500.668625:0:17116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744500.668627:0:17116:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744500.668628:0:17116:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744500.668630:0:17116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744500.668632:0:17116:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744500.668657:0:17116:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac641b52000 from lustre-MDT0000 10000000:01000000:3.0:1788744500.668686:0:17116:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788744500.668690:0:17116:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744500.668694:0:17116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ac643238000 10000000:01000000:3.0:1788744500.668698:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744500.668707:0:17116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac643238000 from 1 10000000:01000000:3.0:1788744500.668709:0:17116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744500.668749:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.668761:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.668785:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.668806:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744500.668862:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.668906:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744500.669164:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154540544 00000100:00100000:0.0:1788744500.669171:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154540544 00000100:00100000:0.0:1788744500.669540:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744500.669552:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+5:17116:x1875634154540544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744500.669565:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744500.669583:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dace00/0xb6207a6e76dcd27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd277 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.669607:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dace00/0xb6207a6e76dcd27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd277 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.669618:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dace00/0xb6207a6e76dcd27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd277 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.669627:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dace00, rc 0) 00000100:00100000:0.0:1788744500.669679:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+6:17116:x1875634154540544:12345-0@lo:101:mount.lustre.0 Request processed in 130us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.669687:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744500.671239:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744500.671274:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.671287:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.671377:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744500.671472:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.678216:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154540672 00000100:00100000:1.0:1788744500.678231:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154540672 00000100:00100000:1.0:1788744500.678302:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744500.678313:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+6:17116:x1875634154540672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744500.678452:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+6:17116:x1875634154540672:12345-0@lo:501:mount.lustre.0 Request processed in 140us (6978us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744500.678460:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744500.682310:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.682353:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540672:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788744500.682557:0:17116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744500.682584:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.682596:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744500.682604:0:17116:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac641b52000 10000000:01000000:3.0:1788744500.682613:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744500.682633:0:17116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ac641b52000 10000000:01000000:3.0:1788744500.682635:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788744500.682639:0:17116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ac641b52000 from 1 10000000:01000000:3.0:1788744500.682641:0:17116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788744500.682678:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.682687:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.682697:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.682718:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744500.682779:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.682804:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744500.683212:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154540800 00000100:00100000:1.0:1788744500.683219:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154540800 00000100:00100000:1.0:1788744500.683278:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744500.683288:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+6:17116:x1875634154540800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744500.683300:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744500.683325:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcd28c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd285 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.683348:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcd28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd285 expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.683359:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741535800/0xb6207a6e76dcd28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd285 expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.683367:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535800, rc 0) 00000100:00100000:1.0:1788744500.683437:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+7:17116:x1875634154540800:12345-0@lo:101:mount.lustre.0 Request processed in 151us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744500.683444:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744500.683615:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744500.683629:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd28c expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.683637:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd28c expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744500.683652:0:17116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788744500.683667:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd28c expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.683673:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfe00/0xb6207a6e76dcd285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd28c expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744500.683692:0:17116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744500.683695:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744500.683700:0:17116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ac641b52000 10000000:01000000:3.0:1788744500.683703:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788744500.683706:0:17116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788744500.683708:0:17116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744500.683726:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.683734:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.683742:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.683756:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744500.683786:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.685212:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774a489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.685365:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154540928 00000100:00100000:2.0:1788744500.685375:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154540928 00000100:00100000:0.0:1788744500.686269:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744500.686283:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+7:17116:x1875634154540928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744500.686301:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744500.686317:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcd29a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd293 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.686374:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcd29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd293 expref: 8 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.686388:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643daca00/0xb6207a6e76dcd29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd293 expref: 8 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.687581:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643daca00, rc 0) 00000100:00100000:3.0:1788744500.687779:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+8:17116:x1875634154540928:12345-0@lo:101:mount.lustre.0 Request processed in 1496us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.687788:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744500.687897:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154540928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744500.687919:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd29a expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.687932:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd29a expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744500.688584:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154541056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744500.688627:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744500.689165:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.689268:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154541056 00000100:00100000:2.0:1788744500.689276:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154541056 00000100:00100000:2.0:1788744500.689314:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744500.689323:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+8:17116:x1875634154541056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744500.689509:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+9:17116:x1875634154541056:12345-0@lo:501:mount.lustre.0 Request processed in 186us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744500.689516:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744500.689670:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154541056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744500.689707:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154541184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744500.689754:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744500.689776:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac642618c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.690048:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154541184 00000100:00100000:3.0:1788744500.690055:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154541184 00000100:00100000:3.0:1788744500.690090:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744500.690098:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+9:17116:x1875634154541184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744500.690845:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+9:17116:x1875634154541184:12345-0@lo:503:mount.lustre.0 Request processed in 742us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.690867:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744500.691546:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154541184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744500.692678:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17155:1875634154541312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744500.692744:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744500.692781:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742b62a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.693163:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154541312 00000100:00100000:3.0:1788744500.693171:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154541312 00000100:00100000:3.0:1788744500.693220:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744500.693230:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+9:17155:x1875634154541312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.694953:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+9:17155:x1875634154541312:12345-0@lo:502:llog_process_th.0 Request processed in 1717us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.694966:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744500.700270:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17155:1875634154541312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744500.700322:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744500.700338:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.700340:0:17155:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788744500.700344:0:17155:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788744500.700347:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744500.700363:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ac77cdf8000) 00000020:00000080:2.0:1788744500.700384:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788744500.700389:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788744500.700640:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788744500.700648:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd2a8 00000020:00000080:2.0:1788744500.700847:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788744500.700852:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744500.700856:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.700857:0:17155:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788744500.700860:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744500.700869:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.700871:0:17155:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788744500.700875:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744500.700883:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ac77cdfcd40) 00000020:00000080:2.0:1788744500.700893:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788744500.700898:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788744500.700900:0:17155:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788744500.700903:0:17155:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788744500.700908:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788744500.700962:0:17155:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac641b52000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788744500.700983:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ac776c2b380) 00000020:00000080:2.0:1788744500.702291:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788744500.702378:0:17155:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788744500.702388:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd2bd 00000020:00000080:2.0:1788744500.702653:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788744500.702660:0:17155:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788744500.702666:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb6207a6e76dcd2c4 00080000:01000000:2.0:1788744500.702672:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788744500.702676:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd2cb 00010000:00010000:2.0:1788744500.822347:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788744500.826382:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788744500.827019:0:17155:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788744500.827563:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ac64323b380) 00000020:00000080:3.0:1788744500.827581:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788744500.827653:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788744500.827663:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd2d9 00000020:00000080:3.0:1788744500.829268:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788744500.840518:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb6207a6e76dcd2e0 00000020:00000080:2.0:1788744500.841121:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788744500.841133:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744500.841141:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.841143:0:17155:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788744500.841145:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788744500.841148:0:17155:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788744500.841149:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744500.841151:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744500.841152:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788744500.841154:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.841156:0:17155:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788744500.841158:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744500.841163:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.841164:0:17155:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788744500.841176:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788744500.841218:0:17155:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788744500.841233:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744500.841236:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.841238:0:17155:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788744500.841240:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744500.841243:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744500.841245:0:17155:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788744500.841248:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744500.841253:0:17155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:2.0:1788744500.841292:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744500.841308:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ac776c2cd40) 00000020:00000080:2.0:1788744500.841323:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788744500.841328:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744500.841395:0:17155:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788744500.841432:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788744500.841440:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd2ee 00010000:00080000:2.0:1788744500.841470:0:17155:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac64450f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744500.844098:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788744500.845791:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744500.845810:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788744500.845877:0:17155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788744500.845906:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd2f5 00000100:00080000:1.0:1788744500.845919:0:17155:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744500.845930:0:17155:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ac64450f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744500.845969:0:17155:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e44e00 x1875634154541440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744500.845993:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788744500.846070:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744500.846075:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.846077:0:17155:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788744500.846080:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744500.846083:0:17155:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788744500.846085:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744500.846086:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744500.846093:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744500.846096:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.846098:0:17155:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744500.846100:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744500.846105:0:17155:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788744500.846109:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.846111:0:17155:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788744500.846114:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744500.846118:0:17155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1788744500.846140:0:17155:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788744500.846143:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744500.846154:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ac77c9b8000) 00000020:00000080:1.0:1788744500.846167:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788744500.846172:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744500.846230:0:17155:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788744500.846236:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788744500.846241:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd303 00010000:00080000:1.0:1788744500.846279:0:17155:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac643703800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744500.846514:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788744500.848297:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154541440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744500.848385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744500.848568:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154541440 00000100:00100000:2.0:1788744500.848576:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154541440 00000100:00100000:2.0:1788744500.848611:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744500.848619:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875634154541440:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788744500.848636:0:17142:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788744500.850901:0:17155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788744500.853209:0:17155:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788744500.859799:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744500.865980:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788744500.886244:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788744500.888049:0:17161:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744500.888288:0:17161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788744500.889211:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744500.889226:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744500.889283:0:17155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788744500.889304:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd30a 00000100:00080000:3.0:1788744500.889314:0:17155:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744500.889326:0:17155:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac643703800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744500.889364:0:17155:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e93800 x1875634154541568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744500.889396:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788744500.889488:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744500.889492:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.889503:0:17155:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788744500.889506:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788744500.889509:0:17155:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788744500.889511:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744500.889512:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744500.889514:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788744500.889516:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.889518:0:17155:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788744500.889520:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744500.889525:0:17155:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788744500.889528:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.889529:0:17155:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788744500.889533:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788744500.889536:0:17155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1788744500.889558:0:17155:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788744500.889560:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744500.889571:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ac64323cd40) 00000020:00000080:3.0:1788744500.889584:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788744500.889589:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788744500.889645:0:17155:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788744500.889651:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788744500.889658:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb6207a6e76dcd318 00010000:00080000:3.0:1788744500.889701:0:17155:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac748bff000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744500.889900:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788744500.889966:0:17155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788744500.889981:0:17155:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788744500.890321:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154541568:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788744500.890374:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154541568 offset 0 length 520: 4 00000040:00080000:3.0:1788744500.896456:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744500.902293:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788744500.902540:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788744500.902954:0:17163:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744500.902959:0:17163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788744500.903600:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744500.903617:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744500.903654:0:17155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788744500.903674:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd31f 00000100:00080000:1.0:1788744500.903683:0:17155:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744500.903694:0:17155:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac748bff000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744500.903740:0:17155:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e46d80 x1875634154541696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744500.903767:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788744500.903817:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744500.903822:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.903824:0:17155:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788744500.903827:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744500.903831:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.903833:0:17155:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744500.903836:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744500.903838:0:17155:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788744500.903841:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744500.903843:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.903844:0:17155:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788744500.903846:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744500.903848:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744500.903850:0:17155:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744500.903853:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788744500.903882:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17155:1875634154541824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744500.903957:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.903993:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744500.904076:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154541696:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788744500.904105:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154541696 offset 0 length 520: 4 00000100:00100000:2.0:1788744500.904919:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154541824 00000100:00100000:2.0:1788744500.904929:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154541824 00000100:00100000:2.0:1788744500.904980:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744500.904989:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+9:17155:x1875634154541824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744500.905156:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+9:17155:x1875634154541824:12345-0@lo:502:llog_process_th.0 Request processed in 167us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744500.905174:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744500.905269:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875634154541440:12345-0@lo:38:llog_process_th.0 Request processed in 56637us (56872us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744500.905278:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788744500.905861:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744500.905867:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788744500.905872:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154541440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744500.905912:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17155:1875634154541824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744500.905942:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744500.905949:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744500.905952:0:17155:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788744500.905957:0:17155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788744500.907370:0:17116:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788744500.907426:0:17116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744500.907445:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd29a expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.907458:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bfc00/0xb6207a6e76dcd293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd29a expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744500.907466:0:17116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac641b52000 from 1 10000000:01000000:2.0:1788744500.907468:0:17116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744500.907504:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.907513:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.907522:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744500.907544:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154541952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744500.907602:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744500.907636:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac760298240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.907813:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154541952 00000100:00100000:2.0:1788744500.907821:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154541952 00000100:00100000:2.0:1788744500.907895:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744500.907915:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+9:17116:x1875634154541952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744500.907928:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744500.907942:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd326 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.907963:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 10 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.907975:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 10 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.907983:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58000, rc 0) 00000100:00100000:2.0:1788744500.908023:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+10:17116:x1875634154541952:12345-0@lo:101:mount.lustre.0 Request processed in 110us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744500.908833:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744500.909808:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154541952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744500.909832:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.909862:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.910480:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542080:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788744500.910552:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.913485:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744500.915705:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542080 00000100:00100000:0.0:1788744500.915721:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542080 00000100:00100000:0.0:1788744500.915786:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744500.915797:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+10:17116:x1875634154542080:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788744500.915822:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788744500.915829:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788744500.915947:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+10:17116:x1875634154542080:12345-0@lo:256:mount.lustre.0 Request processed in 153us (5395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.915955:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744500.916866:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542080:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788744500.917579:0:17116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744500.917605:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.917617:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744500.917626:0:17116:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac641b52000 from 1 10000000:01000000:3.0:1788744500.917628:0:17116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744500.917666:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.917750:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.917761:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.917783:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744500.917836:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.918906:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.921516:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542208 00000100:00100000:2.0:1788744500.921533:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542208 00000100:00100000:0.0:1788744500.921816:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744500.924201:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+10:17116:x1875634154542208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744500.924225:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744500.924251:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd334 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.924294:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.924307:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.924316:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58c00, rc 0) 00000100:00100000:2.0:1788744500.924439:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+11:17116:x1875634154542208:12345-0@lo:101:mount.lustre.0 Request processed in 2612us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744500.924447:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744500.925226:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744500.925251:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.925271:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744500.925381:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744500.925842:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744500.925919:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.927201:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542336 00000100:00100000:3.0:1788744500.927216:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542336 00000100:00100000:3.0:1788744500.927271:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744500.927281:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17116:x1875634154542336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744500.927954:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17116:x1875634154542336:12345-0@lo:501:mount.lustre.0 Request processed in 671us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.927964:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744500.928112:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744500.928168:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744500.928224:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744500.928273:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.928389:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542464 00000100:00100000:3.0:1788744500.928395:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542464 00000100:00100000:3.0:1788744500.928454:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744500.928461:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17116:x1875634154542464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744500.928548:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17116:x1875634154542464:12345-0@lo:503:mount.lustre.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.928555:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744500.929215:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744500.931360:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17165:1875634154542592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.931465:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.931509:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744500.931581:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542592 00000100:00100000:0.0:1788744500.931589:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542592 00000100:00100000:0.0:1788744500.931633:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744500.931642:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17165:x1875634154542592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744500.936903:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17165:x1875634154542592:12345-0@lo:502:llog_process_th.0 Request processed in 5253us (5429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.936918:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744500.942069:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17165:1875634154542592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744500.942117:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744500.942129:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942131:0:17165:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744500.942139:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac641b52000 00000020:00000080:3.0:1788744500.942142:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744500.942151:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744500.942153:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942154:0:17165:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788744500.942157:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744500.942169:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942171:0:17165:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744500.942175:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac641b52000 00000020:00000080:3.0:1788744500.942177:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744500.942253:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744500.942266:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942267:0:17165:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788744500.942270:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744500.942273:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942274:0:17165:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744500.942278:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac641b52000 00000020:00000080:3.0:1788744500.942280:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744500.942299:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744500.942301:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942303:0:17165:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744500.942305:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744500.942307:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.942309:0:17165:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788744500.942312:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac641b52000 00000020:00000080:3.0:1788744500.942314:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744500.942362:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17165:1875634154542720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.942465:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.942500:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.942709:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542720 00000100:00100000:2.0:1788744500.942717:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542720 00000100:00100000:2.0:1788744500.942767:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744500.942777:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+11:17165:x1875634154542720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744500.942908:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+11:17165:x1875634154542720:12345-0@lo:502:llog_process_th.0 Request processed in 132us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744500.942916:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744500.946960:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17165:1875634154542720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744500.947002:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744500.947011:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744500.947013:0:17165:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788744500.947018:0:17165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788744500.947252:0:17116:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788744500.947285:0:17116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744500.947309:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.947335:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744500.947390:0:17116:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788744500.947394:0:17116:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac641b52000 10000000:01000000:1.0:1788744500.947397:0:17116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac641b52000 10000000:01000000:1.0:1788744500.947428:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744500.947435:0:17116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac641b52000 from 1 10000000:01000000:1.0:1788744500.947437:0:17116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744500.947470:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.947478:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.947488:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744500.947508:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744500.947562:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.947595:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.950096:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542848 00000100:00100000:3.0:1788744500.950110:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542848 00000100:00100000:3.0:1788744500.950169:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744500.950188:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+11:17116:x1875634154542848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744500.950206:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744500.950224:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcd349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd342 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.950251:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcd349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd342 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.950274:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be600/0xb6207a6e76dcd349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd342 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.950284:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be600, rc 0) 00000100:00100000:3.0:1788744500.950357:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154542848:12345-0@lo:101:mount.lustre.0 Request processed in 171us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.950364:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744500.952281:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744500.952309:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd349 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744500.952320:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd349 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744500.952447:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744500.952502:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.952544:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.953188:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154542976 00000100:00100000:3.0:1788744500.953197:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154542976 00000100:00100000:3.0:1788744500.953245:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744500.953253:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154542976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744500.953432:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154542976:12345-0@lo:501:mount.lustre.0 Request processed in 178us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.953439:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744500.954101:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154542976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744500.954154:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154543104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744500.954209:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.954238:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745380180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744500.956520:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543104 00000100:00100000:0.0:1788744500.956533:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543104 00000100:00100000:0.0:1788744500.956583:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744500.956593:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154543104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744500.956748:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154543104:12345-0@lo:503:mount.lustre.0 Request processed in 156us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.956756:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744500.956936:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154543104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744500.957564:0:17169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17169:1875634154543232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.957613:0:17169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.957638:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543232 00000100:00100000:3.0:1788744500.957642:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543232 00000100:00100000:3.0:1788744500.957690:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744500.957699:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17169:x1875634154543232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.957798:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17169:x1875634154543232:12345-0@lo:502:llog_process_th.0 Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.957806:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744500.957843:0:17169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.957856:0:17169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17169:1875634154543232:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788744500.957908:0:17169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788744500.957923:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ac77aaacd40) 00000020:00000080:3.0:1788744500.957943:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788744500.958024:0:17169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac641b52000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744500.958028:0:17169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac641b52000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744500.958030:0:17169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac641b52000 4 00010000:00080000:3.0:1788744500.958063:0:17169:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac7501d7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744500.959745:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788744500.959942:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788744500.959982:0:17169:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744500.959994:0:17169:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb6207a6e76dcd357 00000100:00080000:3.0:1788744500.960003:0:17169:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744500.960013:0:17169:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ac7501d7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744500.960042:0:17169:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e91500 x1875634154543360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744500.960082:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154543360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744500.960154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744500.960212:0:17169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744500.962028:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543360 00000100:00100000:0.0:1788744500.962042:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543360 00000100:00100000:0.0:1788744500.962088:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744500.962096:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154543360:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744500.962195:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154543360:12345-0@lo:38:llog_process_th.0 Request processed in 98us (2040us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788744500.962203:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744500.962230:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744500.962239:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac7501d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744500.962244:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788744500.962252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154543360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744500.963704:0:17169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17169:1875634154543488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.963769:0:17169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.963803:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543488 00000100:00100000:3.0:1788744500.963824:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543488 00000100:00100000:3.0:1788744500.963868:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744500.963877:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17169:x1875634154543488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.963990:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17169:x1875634154543488:12345-0@lo:502:llog_process_th.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.963998:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744500.964050:0:17169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.964207:0:17169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17169:1875634154543488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.964253:0:17169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17169:1875634154543616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.964297:0:17169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.964320:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543616 00000100:00100000:3.0:1788744500.964324:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543616 00000100:00100000:3.0:1788744500.964350:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744500.964358:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:17169:x1875634154543616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744500.964456:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:17169:x1875634154543616:12345-0@lo:502:llog_process_th.0 Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.964463:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744500.964500:0:17169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.964513:0:17169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3734829d-853b-494e-83d0-e0bd2808e668:17169:1875634154543616:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788744500.964535:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788744500.964595:0:17116:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788744500.964618:0:17116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744500.964634:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd349 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.964646:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535e00/0xb6207a6e76dcd342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd349 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788744500.964702:0:17116:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788744500.964704:0:17116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744500.964705:0:17116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744500.964707:0:17116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744500.964708:0:17116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744500.964709:0:17116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744500.964711:0:17116:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744500.964712:0:17116:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744500.964714:0:17116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744500.964715:0:17116:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744500.964720:0:17116:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788744500.964722:0:17116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744500.964723:0:17116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744500.964725:0:17116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744500.964726:0:17116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744500.964727:0:17116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744500.964728:0:17116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744500.964729:0:17116:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744500.964730:0:17116:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744500.964731:0:17116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744500.964732:0:17116:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744500.964745:0:17116:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744500.964754:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154543744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744500.964783:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.964801:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744500.964997:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543744 00000100:00100000:3.0:1788744500.965003:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543744 00000100:00100000:3.0:1788744500.965030:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744500.965037:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154543744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744500.965126:0:17131:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788744500.965142:0:17131:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744500.968251:0:17131:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744500.968287:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788744500.968761:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:17116:x1875634154543744:12345-0@lo:253:mount.lustre.0 Request processed in 3719us (3972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.968773:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744500.968981:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17116:1875634154543744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788744500.968997:0:17116:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788744500.969000:0:17116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744500.969003:0:17116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744500.969005:0:17116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744500.969006:0:17116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744500.969007:0:17116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744500.969008:0:17116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744500.969010:0:17116:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744500.969011:0:17116:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744500.969013:0:17116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744500.969015:0:17116:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788744500.969029:0:17116:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788744500.969537:0:17153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744500.969544:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744500.969564:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.969579:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 11 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.969588:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.969830:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 11 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.969847:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 11 pid: 17131 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744500.969861:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154543872:0@lo:104: 00000100:00100000:2.0:1788744500.969903:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744500.969947:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6431e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744500.969983:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154543872 00000100:00100000:2.0:1788744500.969989:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154543872 00000100:00100000:2.0:1788744500.972022:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744500.972044:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+3:17153:x1875634154543872:12345-0@lo:104: 00010000:00010000:2.0:1788744500.972062:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744500.972149:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744500.972155:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+3:17153:x1875634154543872:12345-0@lo:104: Request processed in 121us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744500.972162:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744500.972220:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154543872:0@lo:104: 00010000:00010000:2.0:1788744500.972244:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.972814:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744500.972823:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.972843:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744500.972848:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.973002:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744500.973010:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744500.973016:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744500.973057:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.973064:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744500.973085:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.973094:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd32d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.973122:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744500.973124:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744500.973126:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744500.973183:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154544000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744500.973233:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744500.973880:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544000 00000100:00100000:3.0:1788744500.973888:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544000 00010000:00010000:3.0:1788744500.973916:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 12 pid: 17131 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744500.973949:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744500.973958:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+12:3644:x1875634154544000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744500.973969:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744500.973974:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 12 pid: 17131 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.973986:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 12 pid: 17131 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974002:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd32d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd326 expref: 12 pid: 17131 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974019:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974028:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744500.974045:0:17122:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004501621s 00010000:00010000:3.0:1788744500.974050:0:17122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974070:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974086:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974092:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974098:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744500.974102:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974109:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974133:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744500.974144:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744500.974201:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+11:3644:x1875634154544000:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744500.974208:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744500.974243:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154544000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744500.974513:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.974521:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744500.974528:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b59800/0xb6207a6e76dcd35e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788744500.988046:0:17116:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788744500.989666:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788744500.990198:0:17177:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788744500.990619:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744500.992698:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744500.992775:0:17177:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:3.0:1788744500.994105:0:17176:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788744500.994111:0:17176:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788744500.995009:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:1.0:1788744501.000510:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788744501.000555:0:17116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788744501.000996:0:17116:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788744501.001003:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788744501.001045:0:17116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744501.002013:0:17116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788744501.002573:0:17116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788744501.002599:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:0.0:1788744501.003288:0:17179:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ac6435f0000 x1875634154544128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744501.003300:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00080000:10000000:0.0:1788744501.006024:0:17116:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788744501.007981:0:17116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788744501.014215:0:17116:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788744501.014253:0:17116:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7f9019af988 00100000:10000000:0.0:1788744501.014275:0:17116:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788744501.016324:0:17116:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788744501.016342:0:17116:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788744501.016371:0:17116:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788744501.016388:0:17116:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788744501.019324:0:17116:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744501.019577:0:17116:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788744501.429753:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744501.678520:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744501.678529:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac641b52000 from 7 10000000:01000000:0.0:1788744501.678534:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744501.678597:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744501.678610:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744501.678622:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744501.678651:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154544256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744501.678729:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744501.678788:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74843e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744501.678796:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544256 00000100:00100000:1.0:1788744501.678808:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544256 00000100:00100000:1.0:1788744501.678866:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744501.678876:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+11:17135:x1875634154544256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744501.678890:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744501.678904:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd365 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744501.678927:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 12 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744501.678938:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 12 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744501.678947:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535c00, rc 0) 00000100:00100000:1.0:1788744501.678996:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17135:x1875634154544256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744501.679003:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744501.679089:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154544256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744501.679103:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744501.679112:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744501.679162:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154544384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744501.679191:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744501.679217:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74843e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744501.679284:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544384 00000100:00100000:2.0:1788744501.679289:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544384 00000100:00100000:2.0:1788744501.679325:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744501.679334:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:17135:x1875634154544384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788744501.679348:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744501.679367:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744501.679371:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788744501.679483:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:17135:x1875634154544384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744501.679491:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744501.679694:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154544384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744501.679750:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744501.679758:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744501.679772:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744501.999029:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744502.072323:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744502.448692:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744503.023147:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788744503.090254:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788744503.470771:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744504.110625:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744504.494746:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744505.134785:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788744505.519482:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744505.526804:0:17422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788744506.158843:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00000100:00080000:0.0:1788744506.223420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788744506.223429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788744506.223435:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744506.223447:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1788744506.223455:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788744506.223470:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ac64450f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744506.223505:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f1500 x1875634154544640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744506.223522:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744506.223527:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744506.223530:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744506.223534:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744506.223557:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154544512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744506.223637:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744506.223731:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544512 00000100:00100000:1.0:1788744506.223741:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544512 00000100:00100000:1.0:1788744506.223782:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744506.223790:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:3645:x1875634154544512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744506.223845:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:3645:x1875634154544512:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744506.224013:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154544640:0@lo:38:kworker.0 00000100:00100000:3.0:1788744506.224062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744506.224113:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544640 00000100:00100000:3.0:1788744506.224118:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544640 00000100:00100000:3.0:1788744506.224139:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744506.224144:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875634154544640:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788744506.224165:0:17143:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788744506.224167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788744506.224179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744506.224182:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac7501d7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744506.224197:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ac7501d7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744506.224246:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f2a00 x1875634154544768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744506.224350:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154544512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744506.226526:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744506.236819:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154544768:0@lo:38:kworker.0 00000100:00100000:2.0:1788744506.236909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744506.237094:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544768 00000100:00100000:1.0:1788744506.237103:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544768 00000100:00100000:1.0:1788744506.237170:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744506.237178:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154544768:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788744506.237204:0:17139:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788744506.237258:0:17139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb6207a6e76dcd373 00000004:00100000:1.0:1788744506.237272:0:17139:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744506.237456:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9ac744dea800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744506.237512:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875634154544768:12345-0@lo:38:kworker.0 Request processed in 333us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744506.237520:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744506.240432:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875634154544640:12345-0@lo:38:kworker.0 Request processed in 16278us (16362us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744506.240445:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744506.240622:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac6435f2a00 x1875634154544768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744506.240640:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788744506.240648:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788744506.240653:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788744506.240656:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac7501d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788744506.240663:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875634154544768:0@lo:38:kworker.0 00000100:00080000:3.0:1788744506.240677:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744506.240681:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744506.240684:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154544640:0@lo:38:kworker.0 00000020:00000004:0.0:1788744506.467581:0:17474:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744506.467822:0:17474:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744506.545293:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744507.182470:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00000020:00000004:3.0:1788744507.313120:0:17524:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744507.313311:0:17524:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788744507.567565:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744508.206661:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744508.594236:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744509.230493:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744509.631828:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744510.255932:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00000100:00100000:0.0:1788744510.319858:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744500/real 1788744500] req@ffff9ac643e46d80 x1875634154541696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744510.319886:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e46d80 x1875634154541696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744510.319897:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744500/real 1788744500] req@ffff9ac643e93800 x1875634154541568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744510.319910:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e93800 x1875634154541568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744510.319926:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744510.319940:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744510.319944:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154541696:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788744510.319950:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744510.319955:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744510.319964:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154541568:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788744510.322812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788744510.322818:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788744510.322821:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744510.322829:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1788744510.322841:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788744510.322852:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ac64450f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744510.322873:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e90380 x1875634154545024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744510.322888:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744510.322891:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788744510.322893:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744510.322896:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788744510.322898:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788744510.322901:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac643703800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744510.322909:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e91f80 x1875634154545152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744510.322917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744510.322920:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744510.322922:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744510.322924:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788744510.322927:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788744510.322930:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac748bff000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744510.322937:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e90a80 x1875634154545280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744510.322968:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744510.322981:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154544896:0@lo:400:kworker.0 00000100:00100000:3.0:1788744510.323593:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744510.323651:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154545408:0@lo:400:kworker.0 00000100:00100000:3.0:1788744510.323691:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744510.323736:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154545024:0@lo:38:kworker.0 00000100:00100000:1.0:1788744510.323848:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154545408 00000100:00100000:1.0:1788744510.323856:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154545408 00000100:00100000:1.0:1788744510.323897:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744510.323907:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154545408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744510.324099:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544896 00000100:00100000:2.0:1788744510.324104:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544896 00000100:00100000:2.0:1788744510.324134:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744510.324141:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:3645:x1875634154544896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744510.332539:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154545408:12345-0@lo:400:kworker.0 Request processed in 8623us (8836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744510.332625:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788744510.332704:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac643e90000 x1875634154545408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744510.332719:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154545408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744510.332933:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:3645:x1875634154544896:12345-0@lo:400:kworker.0 Request processed in 8791us (9340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744510.332941:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744510.336601:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744510.336657:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154545152:0@lo:8:kworker.0 00000400:00000100:3.0:1788744510.336705:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154545152 offset 0 length 520: 4 00000100:00100000:3.0:1788744510.336728:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154545280:0@lo:8:kworker.0 00000400:00000100:3.0:1788744510.336748:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154545280 offset 0 length 520: 4 00000100:00100000:1.0:1788744510.336876:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154544896:0@lo:400:kworker.0 00000100:00100000:2.0:1788744510.338469:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154545024 00000100:00100000:2.0:1788744510.338484:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154545024 00000100:00100000:2.0:1788744510.338530:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744510.338538:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875634154545024:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788744510.338558:0:17142:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744510.374152:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875634154545024:12345-0@lo:38:kworker.0 Request processed in 35604us (37550us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744510.374167:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788744510.374182:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744510.374187:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744510.374191:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154545024:0@lo:38:kworker.0 00010000:00010000:0.0:1788744510.638795:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744511.278630:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744511.663269:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744512.302865:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744512.687560:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744513.268996:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744513.330470:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744513.710511:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788744513.786546:0:17869:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788744513.786550:0:17869:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788744513.786552:0:17869:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788744513.786667:0:17869:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ac75575b800 00000020:01000004:1.0:1788744513.786684:0:17869:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788744513.786697:0:17869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788744513.786711:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ac77c9b99c0) 00000020:00000080:1.0:1788744513.786727:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788744513.869036:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788744513.869422:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788744513.870555:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788744513.870912:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788744513.871207:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788744513.871835:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788744513.872165:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788744513.872381:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.876855:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.877061:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.881489:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.882307:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.882684:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.883062:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.883457:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.883881:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.884361:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.884860:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.885450:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.885865:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.886346:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.886906:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.887274:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.887501:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.887916:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.888238:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.888480:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.888887:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.889593:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.892513:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788744513.893112:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.893557:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.894250:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788744513.894550:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788744513.900234:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788744513.900829:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788744513.901827:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788744513.902347:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788744513.906055:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788744513.906637:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788744513.907198:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788744513.907630:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788744513.908367:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788744513.909067:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788744513.910228:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788744513.910881:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788744513.917030:0:17869:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788744513.917291:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788744513.917303:0:17869:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744513.917315:0:17869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcd381 00000020:01000004:3.0:1788744513.917321:0:17869:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788744513.917343:0:17869:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744513.917346:0:17869:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744513.917353:0:17869:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788744513.917423:0:17869:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788744513.917427:0:17869:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788744513.928254:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744513.928295:0:17869:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788744513.928300:0:17869:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744513.928301:0:17869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788744513.928307:0:17869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744513.928308:0:17869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744513.928309:0:17869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744513.928310:0:17869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744513.928312:0:17869:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744513.928313:0:17869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744513.928315:0:17869:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744513.928318:0:17869:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788744513.928321:0:17869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744513.928322:0:17869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788744513.928322:0:17869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744513.928323:0:17869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744513.928324:0:17869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744513.928325:0:17869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744513.928326:0:17869:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744513.928327:0:17869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744513.928327:0:17869:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744513.928352:0:17869:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788744513.928371:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744513.928468:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744513.928587:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744513.930309:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154545536 00000100:00100000:1.0:1788744513.930322:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154545536 00000100:00100000:1.0:1788744513.930385:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744513.930395:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:17869:x1875634154545536:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744513.930589:0:17132:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788744513.930592:0:17132:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788744513.930600:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788744513.931275:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+12:17869:x1875634154545536:12345-0@lo:253:mount.lustre.0 Request processed in 879us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744513.931285:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744513.934149:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744513.934179:0:17869:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788744513.934183:0:17869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744513.934185:0:17869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788744513.934186:0:17869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744513.934187:0:17869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744513.934189:0:17869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744513.934190:0:17869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744513.934191:0:17869:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744513.934193:0:17869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744513.934194:0:17869:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744513.934220:0:17869:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac75575b800 from lustre-MDT0001 10000000:01000000:3.0:1788744513.934254:0:17869:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788744513.934258:0:17869:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788744513.934264:0:17869:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac643238000 local copy 00010000:00010000:3.0:1788744513.934274:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744513.934384:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744513.934471:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744513.934507:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774bf86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744513.935855:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154545664 00000100:00100000:0.0:1788744513.935867:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154545664 00000100:00100000:0.0:1788744513.935922:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744513.935932:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17869:x1875634154545664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744513.936067:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+12:17869:x1875634154545664:12345-0@lo:501:mount.lustre.0 Request processed in 135us (1595us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744513.936075:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744513.936207:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545664:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788744513.936228:0:17869:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788744513.936256:0:17869:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788744513.936263:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.936274:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744513.936301:0:17869:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac75575b800 10000000:01000000:1.0:1788744513.936306:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788744513.936311:0:17869:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ac643238000 10000000:01000000:1.0:1788744513.936314:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788744513.936317:0:17869:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ac643238000 from 1 10000000:01000000:1.0:1788744513.936321:0:17869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788744513.936351:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.936360:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.936369:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744513.936397:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744513.936463:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.936488:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744513.936850:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154545792 00000100:00100000:3.0:1788744513.936856:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154545792 00000100:00100000:3.0:1788744513.936884:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744513.936892:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+12:17869:x1875634154545792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744513.936902:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744513.936917:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437bf000/0xb6207a6e76dcd38f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd388 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744513.936938:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437bf000/0xb6207a6e76dcd38f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd388 expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744513.936948:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437bf000/0xb6207a6e76dcd38f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd388 expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744513.936958:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf000, rc 0) 00000100:00100000:3.0:1788744513.937005:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+13:17869:x1875634154545792:12345-0@lo:101:mount.lustre.0 Request processed in 114us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744513.937011:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744513.940239:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744513.940272:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd38f expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.940284:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd38f expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744513.940312:0:17869:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788744513.940334:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd38f expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.940342:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535a00/0xb6207a6e76dcd388 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd38f expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744513.940353:0:17869:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ac75575b800 10000000:01000000:1.0:1788744513.940361:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788744513.940366:0:17869:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ac75575b800 from 1 10000000:01000000:1.0:1788744513.940369:0:17869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788744513.940431:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.940439:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.940449:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744513.940483:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744513.940557:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.940595:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744513.940935:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154545920 00000100:00100000:3.0:1788744513.940942:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154545920 00000100:00100000:3.0:1788744513.940995:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744513.941005:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+13:17869:x1875634154545920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744513.941019:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744513.941040:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcd39d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd396 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744513.941061:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcd39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd396 expref: 14 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744513.941071:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be000/0xb6207a6e76dcd39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd396 expref: 14 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744513.941079:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be000, rc 0) 00000100:00100000:3.0:1788744513.941131:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+14:17869:x1875634154545920:12345-0@lo:101:mount.lustre.0 Request processed in 128us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744513.941137:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788744513.941644:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154545920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744513.941671:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd39d expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.941679:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd39d expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744513.941695:0:17869:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788744513.941710:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd39d expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.941718:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534400/0xb6207a6e76dcd396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd39d expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744513.941724:0:17869:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788744513.941729:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744513.941900:0:17869:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ac75575b800 10000000:01000000:1.0:1788744513.941904:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788744513.941908:0:17869:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788744513.941911:0:17869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788744513.941933:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.941941:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.941958:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744513.941985:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546048:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744513.942025:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.942112:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744513.946218:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546048 00000100:00100000:0.0:1788744513.946233:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546048 00000100:00100000:0.0:1788744513.946335:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744513.946345:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+14:17869:x1875634154546048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744513.946362:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744513.946378:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dade00/0xb6207a6e76dcd3ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd3a4 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744513.946417:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dade00/0xb6207a6e76dcd3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd3a4 expref: 15 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744513.946429:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dade00/0xb6207a6e76dcd3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd3a4 expref: 15 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744513.946438:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dade00, rc 0) 00000100:00100000:0.0:1788744513.946514:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546048:12345-0@lo:101:mount.lustre.0 Request processed in 170us (4488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744513.946541:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744513.946631:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744513.946650:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd3ab expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744513.946669:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd3ab expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744513.950454:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788744513.951475:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744513.957496:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788744513.957802:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788744513.957823:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788744513.957837:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788744513.957848:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788744513.957861:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788744513.957875:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788744513.957892:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788744513.957904:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788744513.957915:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788744513.957928:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788744513.957939:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788744513.957952:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788744513.957965:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788744513.958067:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788744513.958083:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788744513.958253:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788744513.958269:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788744513.958283:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788744513.958297:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788744513.958313:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788744513.958328:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788744513.958341:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788744513.958367:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788744513.958372:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788744513.958620:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744513.958819:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.958926:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744513.958981:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546176 00000100:00100000:0.0:1788744513.958989:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546176 00000100:00100000:0.0:1788744513.959076:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744513.959099:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744513.959258:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546176:12345-0@lo:501:mount.lustre.0 Request processed in 172us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744513.959265:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744513.959333:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744513.959365:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744513.959429:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.959947:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744513.960096:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546304 00000100:00100000:3.0:1788744513.960103:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546304 00000100:00100000:3.0:1788744513.960135:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744513.960142:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744513.961037:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546304:12345-0@lo:503:mount.lustre.0 Request processed in 891us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744513.961046:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744513.961239:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546304:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744513.961695:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744513.961786:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744513.961834:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.961865:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744513.962434:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546432 00000100:00100000:3.0:1788744513.962442:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546432 00000100:00100000:3.0:1788744513.962477:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744513.962485:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744513.963195:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546432:12345-0@lo:502:mount.lustre.0 Request processed in 707us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744513.963205:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744513.963351:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744513.963573:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788744513.963603:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788744513.963619:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788744513.963642:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788744513.963671:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788744513.963687:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788744513.963700:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788744513.963711:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788744513.963723:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788744513.963744:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788744513.963757:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788744513.963769:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788744513.963782:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788744513.963794:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788744513.963806:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788744513.963819:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788744513.963833:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788744513.963846:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788744513.963859:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788744513.963873:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788744513.963886:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788744513.963896:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788744513.963907:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788744513.963921:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788744513.963932:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788744513.963945:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788744513.963958:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788744513.963969:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788744513.964221:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788744513.964240:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788744513.964254:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788744513.964268:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788744513.964283:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788744513.964295:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788744513.964306:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788744513.964321:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788744513.964347:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788744513.964362:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788744513.964376:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788744513.964391:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788744513.964426:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788744513.964445:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788744513.964460:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788744513.964474:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788744513.964510:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744513.964568:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744513.964605:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744513.964941:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546560 00000100:00100000:3.0:1788744513.964954:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546560 00000100:00100000:3.0:1788744513.964999:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744513.965007:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744513.965313:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154546560:12345-0@lo:502:mount.lustre.0 Request processed in 306us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744513.965321:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744513.965544:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154546560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744513.965599:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788744513.965608:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788744513.966966:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744513.967050:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744513.967053:0:17873:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788744513.967060:0:17873:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788744513.967063:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744513.967077:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ac77aaa99c0) 00000020:00000080:3.0:1788744513.967150:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788744513.967158:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788744513.967267:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788744513.967274:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcd3b9 00000020:00000080:3.0:1788744513.967789:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788744513.967796:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744513.967800:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744513.967801:0:17873:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788744513.967804:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744513.967808:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744513.967810:0:17873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788744513.967813:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744513.967822:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ac77aaab380) 00000020:00000080:3.0:1788744513.967834:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788744513.967839:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788744513.967841:0:17873:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788744513.967844:0:17873:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788744513.967849:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788744513.967908:0:17873:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac75575b800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788744513.967921:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ac77aaa8000) 00000020:00000080:3.0:1788744513.967936:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788744513.968073:0:17873:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788744513.968080:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd3ce 00000020:00000080:3.0:1788744513.968247:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788744513.968254:0:17873:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788744513.968259:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb6207a6e76dcd3d5 00080000:01000000:3.0:1788744513.968265:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788744513.968269:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcd3dc 00010000:00010000:3.0:1788744514.069226:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788744514.069948:0:17873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788744514.070266:0:17873:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788744514.071570:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788744514.071586:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.071593:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.071596:0:17873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788744514.071599:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744514.071605:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.071607:0:17873:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788744514.071610:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744514.071616:0:17873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:1.0:1788744514.071659:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744514.071679:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ac77c9bcd40) 00000020:00000080:1.0:1788744514.071701:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788744514.071707:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744514.071794:0:17873:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788744514.071801:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788744514.071808:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcd3ea 00010000:00080000:1.0:1788744514.071841:0:17873:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac75575a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744514.073455:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788744514.073961:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744514.073977:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788744514.074026:0:17873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788744514.074049:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd3f1 00000100:00080000:1.0:1788744514.074060:0:17873:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744514.074070:0:17873:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ac75575a000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744514.074127:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e46d80 x1875634154546688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744514.074151:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788744514.074207:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.074211:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.074213:0:17873:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788744514.074216:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744514.074218:0:17873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788744514.074220:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744514.074222:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744514.074224:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744514.074227:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.074228:0:17873:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744514.074231:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744514.074236:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.074238:0:17873:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788744514.074242:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788744514.074281:0:17873:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788744514.074294:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.074298:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.074299:0:17873:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788744514.074301:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744514.074303:0:17873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788744514.074304:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744514.074312:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744514.074314:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744514.074318:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.074319:0:17873:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744514.074321:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744514.074324:0:17873:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788744514.074328:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.074329:0:17873:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788744514.074333:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744514.074337:0:17873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1788744514.074360:0:17873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788744514.074363:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744514.074376:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ac77c9bb380) 00000020:00000080:1.0:1788744514.074389:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788744514.074395:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744514.074531:0:17873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788744514.074539:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788744514.074546:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcd3ff 00010000:00080000:1.0:1788744514.074586:0:17873:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac750724000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744514.074838:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788744514.075067:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154546688:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744514.075127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788744514.075430:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744514.075436:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788744514.075439:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744514.075444:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1788744514.075448:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788744514.075455:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ac64450f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744514.075481:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643357b80 x1875634154546816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744514.075495:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744514.075499:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744514.075502:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744514.075505:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744514.075545:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154546944:0@lo:400:kworker.0 00000100:00100000:2.0:1788744514.075578:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.075625:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546944 00000100:00100000:2.0:1788744514.075631:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546944 00000100:00100000:2.0:1788744514.075679:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744514.075687:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154546944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744514.075732:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154546944:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.075740:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744514.075776:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac643355500 x1875634154546944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744514.075800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154546944:0@lo:400:kworker.0 00000100:00100000:2.0:1788744514.075854:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546688 00000100:00100000:2.0:1788744514.075858:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546688 00000100:00100000:2.0:1788744514.075878:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744514.075883:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875634154546688:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788744514.075901:0:17143:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1788744514.075929:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd406 00000004:00100000:2.0:1788744514.075940:0:17143:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788744514.075945:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788744514.076913:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154546816:0@lo:38:kworker.0 00000100:00100000:1.0:1788744514.076963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.077094:0:17142:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788744514.077104:0:17142:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788744514.077340:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154546816 00000100:00100000:1.0:1788744514.077346:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154546816 00000100:00100000:3.0:1788744514.077488:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744514.077495:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875634154546816:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788744514.077577:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875634154546816:12345-0@lo:38:kworker.0 Request processed in 81us (612us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788744514.077585:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744514.077866:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744514.077874:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744514.077878:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788744514.077883:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154546816:0@lo:38:kworker.0 00000040:01000000:2.0:1788744514.079864:0:17873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1788744514.082073:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9ac7447d8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744514.082179:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875634154546688:12345-0@lo:38:llog_process_th.0 Request processed in 6284us (7041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.082195:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744514.082320:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744514.082330:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788744514.082338:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788744514.082343:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744514.082346:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac75575a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744514.082370:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154546688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744514.082494:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744514.082508:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154547072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744514.082565:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.082599:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154547072 00000100:00100000:0.0:1788744514.082605:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154547072 00000100:00100000:0.0:1788744514.082638:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744514.082646:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875634154547072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744514.082903:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788744514.082943:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875634154547072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 297us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.082949:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:2.0:1788744514.083106:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788744514.083328:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154547072:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788744514.085468:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744514.085949:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788744514.086101:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788744514.086933:0:17879:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788744514.086939:0:17879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788744514.087945:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744514.087957:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744514.088066:0:17873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788744514.088087:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd40d 00000100:00080000:1.0:1788744514.088097:0:17873:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744514.088108:0:17873:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ac750724000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744514.088142:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e46d80 x1875634154547200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744514.088210:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154547200:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788744514.088261:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154547200 offset 0 length 520: 4 00000100:00080000:1.0:1788744514.088314:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788744514.088425:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.088429:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.088430:0:17873:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788744514.088433:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744514.088435:0:17873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788744514.088437:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744514.088438:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744514.088440:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744514.088442:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.088443:0:17873:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744514.088445:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744514.088449:0:17873:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788744514.088452:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.088453:0:17873:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788744514.088466:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744514.088469:0:17873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1788744514.088489:0:17873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788744514.088491:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744514.088503:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ac750753380) 00000020:00000080:1.0:1788744514.088516:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788744514.088531:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744514.088596:0:17873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788744514.088603:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788744514.088608:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb6207a6e76dcd41b 00010000:00080000:1.0:1788744514.088634:0:17873:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac751dc6000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.104@tcp at head 00000100:00080000:2.0:1788744514.088766:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744514.088771:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744514.088773:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744514.088776:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788744514.089064:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788744514.089123:0:17873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788744514.089135:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788744514.091392:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744514.092019:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788744514.092144:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788744514.093244:0:17881:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788744514.093250:0:17881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788744514.094223:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744514.094233:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744514.094268:0:17873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788744514.094289:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd422 00000100:00080000:1.0:1788744514.094299:0:17873:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744514.094309:0:17873:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ac751dc6000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744514.094344:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e44e00 x1875634154547328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744514.096702:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788744514.096847:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744514.096852:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744514.096855:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744514.096872:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788744514.096941:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.096948:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.096950:0:17873:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788744514.096953:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744514.096958:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.096959:0:17873:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744514.096962:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744514.096964:0:17873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788744514.097027:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.097032:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.097033:0:17873:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788744514.097036:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744514.097039:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.097040:0:17873:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744514.097044:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788744514.097077:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744514.097080:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.097081:0:17873:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744514.097084:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788744514.097136:0:17869:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788744514.097166:0:17869:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788744514.097192:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd3ab expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.097204:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534e00/0xb6207a6e76dcd3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd3ab expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744514.097213:0:17869:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75575b800 from 1 10000000:01000000:1.0:1788744514.097216:0:17869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744514.097250:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.097267:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.097279:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744514.097300:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744514.097364:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.097398:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.097663:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154547328:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788744514.097698:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154547328 offset 0 length 520: 4 00000100:00100000:3.0:1788744514.097747:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154547456 00000100:00100000:3.0:1788744514.097754:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154547456 00000100:00100000:3.0:1788744514.097821:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744514.097831:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+15:17869:x1875634154547456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744514.097852:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744514.097866:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd429 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.097889:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 16 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.097899:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 16 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.097907:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be800, rc 0) 00000100:00100000:3.0:1788744514.097941:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+16:17869:x1875634154547456:12345-0@lo:101:mount.lustre.0 Request processed in 111us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.097948:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744514.098465:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744514.098481:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.098490:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744514.099362:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547584:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788744514.099434:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.099595:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.102313:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154547584 00000100:00100000:2.0:1788744514.102328:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154547584 00000100:00100000:2.0:1788744514.102388:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744514.102398:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+16:17869:x1875634154547584:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788744514.102580:0:17130:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788744514.102612:0:17130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788744514.102615:0:17130:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788744514.103032:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+16:17869:x1875634154547584:12345-0@lo:256:mount.lustre.0 Request processed in 634us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.103040:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744514.104754:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547584:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788744514.105476:0:17869:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744514.105498:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.105510:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744514.105547:0:17869:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75575b800 from 1 10000000:01000000:1.0:1788744514.105550:0:17869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744514.106211:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.106223:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.106232:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744514.106252:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744514.106308:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.106383:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.106923:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154547712 00000100:00100000:0.0:1788744514.106942:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154547712 00000100:00100000:0.0:1788744514.107122:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744514.107133:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+16:17869:x1875634154547712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744514.107148:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744514.107163:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd437 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.107198:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.107209:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.107218:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac400, rc 0) 00000100:00100000:0.0:1788744514.107277:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154547712:12345-0@lo:101:mount.lustre.0 Request processed in 146us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.107284:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744514.107359:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744514.107375:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.107385:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744514.107531:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744514.107873:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744514.107908:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.108230:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.108311:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154547840 00000100:00100000:3.0:1788744514.108318:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154547840 00000100:00100000:3.0:1788744514.108346:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744514.108352:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154547840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744514.108462:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154547840:12345-0@lo:501:mount.lustre.0 Request processed in 110us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.108469:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744514.108584:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744514.108613:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744514.108670:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.108687:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.108938:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154547968 00000100:00100000:3.0:1788744514.108943:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154547968 00000100:00100000:3.0:1788744514.108960:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744514.108966:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154547968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744514.109059:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154547968:12345-0@lo:503:mount.lustre.0 Request processed in 92us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.109074:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744514.109275:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154547968:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744514.109886:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744514.109958:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744514.110065:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.110190:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.110360:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548096 00000100:00100000:3.0:1788744514.110367:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548096 00000100:00100000:3.0:1788744514.110393:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788744514.110428:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154548096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744514.110539:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154548096:12345-0@lo:502:mount.lustre.0 Request processed in 138us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.110546:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744514.111045:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744514.111367:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788744514.111397:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788744514.111802:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788744514.111825:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788744514.111841:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788744514.111854:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788744514.111887:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788744514.111905:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788744514.111920:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788744514.111935:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788744514.111950:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788744514.112808:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744514.112881:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.112962:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.113049:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548224 00000100:00100000:3.0:1788744514.113057:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548224 00000100:00100000:3.0:1788744514.113123:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744514.113132:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154548224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744514.113248:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154548224:12345-0@lo:502:mount.lustre.0 Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.113256:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788744514.113325:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744514.113382:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788744514.113393:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788744514.114800:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744514.114814:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.114817:0:17883:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788744514.114825:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac75575b800 00000020:00000080:0.0:1788744514.114828:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744514.114835:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.114837:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.114839:0:17883:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788744514.114841:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744514.114843:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.114844:0:17883:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788744514.114847:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac75575b800 00000020:00000080:0.0:1788744514.114849:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744514.114938:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.114949:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.114951:0:17883:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788744514.114954:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744514.114957:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.114958:0:17883:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744514.114962:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac75575b800 00000020:00000080:0.0:1788744514.114964:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744514.120699:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.120712:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.120715:0:17883:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744514.120719:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744514.120723:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.120724:0:17883:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788744514.120738:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac75575b800 00000020:00000080:0.0:1788744514.120741:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744514.120801:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.120805:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.120806:0:17883:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788744514.120809:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788744514.121191:0:17869:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788744514.121221:0:17869:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744514.121252:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.121265:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744514.121320:0:17869:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788744514.121324:0:17869:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac75575b800 10000000:01000000:1.0:1788744514.121326:0:17869:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac75575b800 10000000:01000000:1.0:1788744514.121330:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744514.121335:0:17869:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac75575b800 from 1 10000000:01000000:1.0:1788744514.121337:0:17869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744514.121372:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.121381:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.121392:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744514.121434:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744514.121499:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.125906:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75128acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.126046:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548352 00000100:00100000:2.0:1788744514.126055:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548352 00000100:00100000:2.0:1788744514.128270:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744514.128288:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+17:17869:x1875634154548352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744514.128307:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744514.128324:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd44c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd445 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.128350:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd44c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd445 expref: 18 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.128360:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58000/0xb6207a6e76dcd44c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd445 expref: 18 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.128368:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58000, rc 0) 00000100:00100000:2.0:1788744514.128454:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548352:12345-0@lo:101:mount.lustre.0 Request processed in 172us (6955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.128461:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744514.129124:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744514.129144:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd44c expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.129154:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd44c expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744514.137710:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788744514.138301:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744514.138896:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788744514.138923:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788744514.138938:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788744514.138949:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788744514.138960:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788744514.139042:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788744514.139062:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788744514.139095:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788744514.139112:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788744514.139126:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788744514.139140:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788744514.139153:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788744514.139166:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788744514.142886:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788744514.142911:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788744514.142924:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788744514.142936:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788744514.142948:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788744514.142959:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788744514.143078:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788744514.143101:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788744514.143116:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788744514.143132:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788744514.143167:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788744514.143198:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788744514.143211:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788744514.143232:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788744514.143247:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788744514.143270:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788744514.143282:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788744514.143387:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744514.143508:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.143544:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75128af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.144105:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548480 00000100:00100000:3.0:1788744514.144114:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548480 00000100:00100000:3.0:1788744514.144182:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744514.144191:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744514.144322:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548480:12345-0@lo:501:mount.lustre.0 Request processed in 131us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.144329:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788744514.145093:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744514.145142:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744514.145208:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.145243:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75128af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.145668:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548608 00000100:00100000:2.0:1788744514.145676:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548608 00000100:00100000:2.0:1788744514.145717:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744514.145726:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744514.145954:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548608:12345-0@lo:503:mount.lustre.0 Request processed in 229us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.146111:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744514.146293:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548608:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744514.148277:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744514.148369:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744514.148479:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.148526:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75128acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.149090:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548736 00000100:00100000:2.0:1788744514.149099:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548736 00000100:00100000:2.0:1788744514.149147:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744514.149155:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744514.149284:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548736:12345-0@lo:502:mount.lustre.0 Request processed in 129us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.149291:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744514.149348:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744514.152958:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788744514.153013:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788744514.153035:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788744514.153050:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788744514.153077:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788744514.153090:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788744514.153103:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788744514.153115:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788744514.153127:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788744514.153137:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788744514.153147:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788744514.153157:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788744514.153167:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788744514.153193:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788744514.153206:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788744514.153217:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788744514.153227:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788744514.153239:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788744514.153250:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788744514.153263:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788744514.153292:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788744514.153306:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788744514.153320:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788744514.153333:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788744514.153346:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788744514.153357:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788744514.153369:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788744514.153380:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788744514.153394:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788744514.153426:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788744514.153441:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788744514.153453:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788744514.153467:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788744514.153480:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788744514.153493:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788744514.153504:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788744514.153528:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788744514.153541:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788744514.153553:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788744514.154031:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788744514.154050:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788744514.154064:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788744514.154077:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788744514.154091:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788744514.154105:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788744514.154118:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788744514.154130:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788744514.154145:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788744514.154209:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744514.154288:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.154388:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742bf7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.158054:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548864 00000100:00100000:3.0:1788744514.158070:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548864 00000100:00100000:3.0:1788744514.158167:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744514.158187:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744514.158368:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548864:12345-0@lo:502:mount.lustre.0 Request processed in 183us (4080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.158376:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788744514.158533:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744514.158785:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788744514.158815:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788744514.158853:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744514.158901:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.161457:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75128a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.161748:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154548992 00000100:00100000:2.0:1788744514.161764:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154548992 00000100:00100000:2.0:1788744514.161808:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744514.161818:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744514.162147:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154548992:12345-0@lo:502:mount.lustre.0 Request processed in 329us (3244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.162155:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744514.162270:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154548992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744514.162354:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788744514.162367:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788744514.166587:0:17888:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788744514.166604:0:17888:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ac6433c3380) 00000020:00000080:0.0:1788744514.166626:0:17888:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788744514.166703:0:17888:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac75575b800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788744514.166707:0:17888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac75575b800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788744514.166709:0:17888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac75575b800 3 00010000:00080000:0.0:1788744514.166814:0:17888:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac77f7d6800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788744514.170221:0:17888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788744514.171850:0:17888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788744514.171907:0:17888:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744514.171922:0:17888:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb6207a6e76dcd45a 00000100:00080000:0.0:1788744514.171933:0:17888:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744514.171946:0:17888:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ac77f7d6800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744514.171983:0:17888:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f2300 x1875634154549120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744514.172015:0:17888:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788744514.172843:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788744514.172851:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154549120:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788744514.172852:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744514.172857:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744514.172862:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744514.172928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.172983:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549120 00000100:00100000:0.0:1788744514.172992:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549120 00000100:00100000:0.0:1788744514.173036:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744514.173044:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875634154549120:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788744514.173071:0:17137:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1788744514.173121:0:17137:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb6207a6e76dcd461 00000004:00100000:0.0:1788744514.173138:0:17137:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744514.173180:0:17137:0:(import.c:65:import_set_state_nolock()) ffff9ac7602d6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744514.173283:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875634154549120:12345-0@lo:38:llog_process_th.0 Request processed in 238us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.173292:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788744514.176023:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac6435f2300 x1875634154549120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744514.176040:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744514.176060:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788744514.176068:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788744514.176074:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744514.176078:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac77f7d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744514.176086:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875634154549120:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788744514.179557:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788744514.179934:0:17869:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788744514.179969:0:17869:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744514.179986:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd44c expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.179998:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535200/0xb6207a6e76dcd445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd44c expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744514.180054:0:17869:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744514.180056:0:17869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744514.180058:0:17869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744514.180059:0:17869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744514.180060:0:17869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744514.180062:0:17869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744514.180063:0:17869:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744514.180065:0:17869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744514.180066:0:17869:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744514.180070:0:17869:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788744514.180072:0:17869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744514.180074:0:17869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744514.180075:0:17869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744514.180076:0:17869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744514.180077:0:17869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744514.180078:0:17869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744514.180079:0:17869:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744514.180080:0:17869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744514.180081:0:17869:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744514.180106:0:17869:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788744514.180130:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154549248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744514.180206:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.180250:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac760298cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.180466:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549248 00000100:00100000:3.0:1788744514.180474:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549248 00000100:00100000:3.0:1788744514.180534:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788744514.180545:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac761f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154549248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744514.180787:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788744514.180801:0:17132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788744514.188508:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788744514.189211:0:17132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744514.189298:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788744514.190359:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac761f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17869:x1875634154549248:12345-0@lo:253:mount.lustre.0 Request processed in 9809us (10145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.190374:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788744514.190483:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:17869:1875634154549248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744514.190497:0:17869:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788744514.190501:0:17869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744514.190503:0:17869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788744514.190504:0:17869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744514.190505:0:17869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744514.190506:0:17869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744514.190507:0:17869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744514.190509:0:17869:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744514.190511:0:17869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744514.190512:0:17869:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788744514.190765:0:17869:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788744514.192358:0:17153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744514.192367:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744514.192391:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.192433:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 17 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.192441:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 17 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.192449:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.192483:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 17 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.192497:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 17 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.192511:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154549376:0@lo:104: 00000100:00100000:0.0:1788744514.192561:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744514.192613:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 17 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.192622:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 17 pid: 17130 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.192630:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154549504:0@lo:104: 00000100:00100000:0.0:1788744514.192646:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.192663:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac744d9d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.192751:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549376 00000100:00100000:2.0:1788744514.192760:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549376 00000100:00100000:1.0:1788744514.192781:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549504 00000100:00100000:1.0:1788744514.192787:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549504 00000100:00100000:2.0:1788744514.192799:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744514.192810:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154549376:12345-0@lo:104: 00010000:00010000:2.0:1788744514.192822:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.193084:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744514.193091:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154549376:12345-0@lo:104: Request processed in 284us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.193099:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744514.193117:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744514.193123:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:17153:x1875634154549504:12345-0@lo:104: 00010000:00010000:2.0:1788744514.193131:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.193163:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744514.193180:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:17153:x1875634154549504:12345-0@lo:104: Request processed in 47us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.193187:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744514.193222:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154549376:0@lo:104: 00000100:00100000:1.0:1788744514.193231:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154549504:0@lo:104: 00010000:00010000:1.0:1788744514.193248:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193491:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744514.193497:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193505:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534600 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744514.193509:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193518:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744514.193525:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744514.193531:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744514.193556:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193568:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744514.193590:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193597:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534600/0xb6207a6e76dcd429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd430 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193608:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744514.193610:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193616:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744514.193619:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193625:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744514.193631:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744514.193636:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744514.193646:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193652:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744514.193661:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193668:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd36c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.193683:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744514.193685:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744514.193687:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744514.193946:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744514.193967:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154549632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744514.194040:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.194081:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154549760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744514.194116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.194775:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549632 00000100:00100000:2.0:1788744514.194785:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549632 00010000:00010000:2.0:1788744514.194817:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 18 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.195084:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549760 00000100:00100000:2.0:1788744514.195089:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549760 00010000:00010000:2.0:1788744514.195104:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 19 pid: 17130 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.195120:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744514.195129:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+19:3645:x1875634154549632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744514.195142:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744514.195148:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 19 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195160:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 19 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195187:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd429 expref: 19 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195202:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744514.195249:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+18:3645:x1875634154549632:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.195256:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744514.195282:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744514.195289:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+17:3643:x1875634154549760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744514.195298:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744514.195303:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 17 pid: 17130 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195313:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 17 pid: 17130 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195322:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741535c00/0xb6207a6e76dcd36c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd365 expref: 17 pid: 17130 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195334:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195342:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788744514.195358:0:17122:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004501621s 00010000:00010000:2.0:1788744514.195363:0:17122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195370:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195377:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195384:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195389:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744514.195418:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195428:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195444:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195453:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744514.195482:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+16:3643:x1875634154549760:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.195489:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788744514.195512:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195532:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.195538:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd468 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.195593:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154549760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744514.195624:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154549632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744514.197514:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788744514.207603:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788744514.207806:0:17894:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788744514.207811:0:17894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788744514.208210:0:17895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788744514.208361:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788744514.209029:0:17895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788744514.209994:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788744514.210031:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788744514.210460:0:17869:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788744514.210467:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788744514.210505:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744514.211528:0:17869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788744514.211921:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1875634154549888:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788744514.212044:0:17869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:0.0:1788744514.212055:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788744514.212074:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1788744514.212110:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154549888 00000100:00100000:0.0:1788744514.212117:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154549888 00000100:00100000:0.0:1788744514.212158:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1788744514.212163:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744514.212177:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17896:x1875634154549888:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.212253:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17896:x1875634154549888:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.212261:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744514.212290:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac744d9dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.212315:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1875634154549888:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788744514.212346:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788744514.212371:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1875634154550016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.212423:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.212446:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550016 00000100:00100000:0.0:1788744514.212450:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550016 00000100:00100000:0.0:1788744514.212475:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744514.212483:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17896:x1875634154550016:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.212580:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17896:x1875634154550016:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.212586:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744514.212604:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b10240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.212619:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1875634154550016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.212671:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17896:1875634154550144:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.212703:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.212740:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550144 00000100:00100000:1.0:1788744514.212746:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550144 00000100:00100000:1.0:1788744514.212773:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744514.212780:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1875634154550144:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788744514.212820:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1875634154550144:12345-0@lo:900:lod0001_rec0000.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.212826:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:1.0:1788744514.212929:0:17869:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1788744514.213035:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b10300 going to sleep for 11 seconds 00010000:00080000:0.0:1788744514.213056:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac6435f3100 x1875634154550144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788744530 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744514.213078:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17896:1875634154550144:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.213116:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1875634154550272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.213140:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.213840:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b10240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.222304:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550272 00000100:00100000:1.0:1788744514.222317:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550272 00000100:00100000:1.0:1788744514.222370:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744514.222380:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1875634154550272:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744514.223565:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1875634154550272:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788744514.223624:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744514.224004:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1875634154550272:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1623us (10859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.224025:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:1.0:1788744514.225915:0:17869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788744514.228129:0:17869:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788744514.228166:0:17869:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa7f9016ab988 00100000:10000000:2.0:1788744514.228185:0:17869:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788744514.229373:0:17869:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744514.229433:0:17869:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744514.229456:0:17869:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788744514.229479:0:17869:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1788744514.229933:0:17895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788744514.229980:0:17895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788744514.230381:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744514.230445:0:17896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788744514.230450:0:17896:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:3.0:1788744514.233067:0:17869:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744514.233330:0:17869:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788744514.352008:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788744514.734750:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744515.247216:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788744515.374524:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 10000000:01000000:0.0:1788744515.632478:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744515.632486:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75575b800 from 8 10000000:01000000:0.0:1788744515.632492:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744515.632536:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.632549:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.632560:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744515.632586:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744515.632651:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744515.632711:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa4cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744515.632739:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550400 00000100:00100000:3.0:1788744515.632748:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550400 00000100:00100000:3.0:1788744515.632853:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788744515.632866:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac761f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+16:17135:x1875634154550400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744515.632883:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744515.632897:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd46f expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744515.632934:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 17 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744515.632946:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 17 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744515.632956:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bf400, rc 0) 00000100:00100000:3.0:1788744515.633011:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac761f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154550400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744515.633018:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744515.633096:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744515.633111:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744515.633121:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744515.633186:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788744515.633216:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744515.638395:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744515.641709:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550528 00000100:00100000:0.0:1788744515.641725:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550528 00000100:00100000:0.0:1788744515.641789:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744515.641813:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac761f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154550528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744515.641844:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744515.641863:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744515.641867:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788744515.642196:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac761f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154550528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 384us (8976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744515.642204:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744515.642571:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744515.642626:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744515.642636:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.642648:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744515.642658:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744515.642660:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac641b52000 from 8 10000000:01000000:0.0:1788744515.642662:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744515.642691:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.642698:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.642706:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744515.642728:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744515.642773:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744515.642804:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa4c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744515.642816:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550656 00000100:00100000:0.0:1788744515.642821:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550656 00000100:00100000:0.0:1788744515.642847:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744515.642854:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154550656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744515.642865:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744515.642877:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd47d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.642897:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.642908:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.642927:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dada00, rc 0) 00000100:00100000:0.0:1788744515.642957:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154550656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744515.643171:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744515.643215:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744515.643229:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.643237:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744515.643278:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744515.643313:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744515.643328:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa4c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744515.643338:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550784 00000100:00100000:3.0:1788744515.643344:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550784 00000100:00100000:3.0:1788744515.643375:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744515.643382:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154550784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788744515.643396:0:17130:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744515.643428:0:17130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744515.643432:0:17130:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788744515.643506:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154550784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744515.643521:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744515.643725:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154550784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744515.643759:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744515.643765:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744515.643773:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744515.758615:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744516.272823:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788744516.398928:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788744516.788103:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744517.424783:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788744517.808248:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744518.446629:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00000001:02000400:2.0:1788744518.793491:0:18138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788744518.833015:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744519.477567:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 0 seconds 00000100:00100000:0.0:1788744519.534813:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154550912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744519.534883:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744519.534983:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154550912 00000100:00100000:3.0:1788744519.534992:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154550912 00000100:00100000:3.0:1788744519.535038:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744519.535047:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154550912:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788744519.535058:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744519.535062:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788744519.535066:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744519.535076:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ac64450f000 using connection 192.168.203.104@tcp/0@lo 00000004:00000024:3.0:1788744519.535079:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788744519.535094:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643354380 x1875634154551168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744519.535109:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744519.535113:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744519.535115:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744519.535118:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788744519.535122:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154550912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744519.535129:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744519.535197:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744519.535206:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3734829d-853b-494e-83d0-e0bd2808e668:3646:1875634154551040:0@lo:400:kworker.0 00000100:00100000:0.0:1788744519.535238:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744519.535297:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154550912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744519.535368:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551040 00000100:00100000:3.0:1788744519.535373:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551040 00000100:00100000:3.0:1788744519.535446:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744519.535453:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:3646:x1875634154551040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744519.535487:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:3646:x1875634154551040:12345-0@lo:400:kworker.0 Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744519.535494:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744519.535691:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3734829d-853b-494e-83d0-e0bd2808e668:3646:1875634154551040:0@lo:400:kworker.0 00000100:00080000:2.0:1788744519.536004:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744519.536008:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744519.536010:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744519.536013:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744519.536056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744519.536066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154551296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744519.536113:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744519.536294:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744519.536304:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154551424:0@lo:400:kworker.0 00000100:00100000:0.0:1788744519.536333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744519.536375:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551296 00000100:00100000:0.0:1788744519.536381:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551296 00000100:00100000:0.0:1788744519.536429:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551424 00000100:00100000:0.0:1788744519.536432:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551424 00000100:00100000:0.0:1788744519.536445:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744519.536458:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154551296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744519.536494:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154551296:12345-0@lo:400:kworker.0 Request processed in 37us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744519.536500:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744519.536514:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744519.536533:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154551424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744519.536562:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154551424:12345-0@lo:400:kworker.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744519.536568:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744519.536595:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643355c00 x1875634154551424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744519.536607:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154551424:0@lo:400:kworker.0 00010000:00080000:2.0:1788744519.537022:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643355180 x1875634154551296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744519.537032:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154551296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744519.537052:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154551168:0@lo:38:kworker.0 00000100:00100000:2.0:1788744519.537083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744519.537271:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551168 00000100:00100000:1.0:1788744519.537276:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551168 00000100:00100000:1.0:1788744519.537301:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744519.537307:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875634154551168:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788744519.537328:0:17878:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1788744519.537358:0:17878:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd48b 00000004:00100000:1.0:1788744519.537372:0:17878:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788744519.537377:0:17878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788744519.554956:0:17878:0:(import.c:65:import_set_state_nolock()) ffff9ac77b985800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744519.555057:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875634154551168:12345-0@lo:38:kworker.0 Request processed in 17747us (17970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744519.555083:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788744519.558414:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788744519.558429:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788744519.558439:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788744519.558442:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac64450f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788744519.558462:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007ef2ad6b): req@ffff9ac6435f0000 x1875634154544128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744519.558483:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154551168:0@lo:38:kworker.0 00000100:00100000:2.0:1788744519.558584:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744519.558614:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6424aad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744519.558632:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154544128 00000100:00100000:2.0:1788744519.558638:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154544128 00000100:00100000:2.0:1788744519.558681:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744519.558690:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17179:x1875634154544128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788744519.558765:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17179:x1875634154544128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744519.558783:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744519.558819:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875634154544128:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788744519.558911:0:17179:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788744519.558952:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875634154551552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788744519.558980:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744519.559002:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7556003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744519.559014:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551552 00000100:00100000:2.0:1788744519.559018:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551552 00000100:00100000:2.0:1788744519.559039:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744519.559045:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17179:x1875634154551552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788744519.559796:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744519.559807:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154551680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744519.559838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744519.562343:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17179:x1875634154551552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 3287us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744519.562359:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744519.562390:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551680 00000100:00100000:2.0:1788744519.562399:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551680 00000100:00100000:2.0:1788744519.562443:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744519.562450:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154551680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744519.562483:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788744519.562501:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875634154551552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788744519.562546:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154551680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744519.562552:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744519.562589:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154551680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744519.563618:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875634154551808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788744519.563666:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744519.563688:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77b935cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744519.563712:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551808 00000100:00100000:3.0:1788744519.563726:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551808 00000100:00100000:3.0:1788744519.563761:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744519.563768:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17179:x1875634154551808:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788744519.563833:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17179:x1875634154551808:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744519.563840:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744519.563872:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875634154551808:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788744519.563916:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744519.571127:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788744519.571206:0:17179:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788744519.571212:0:17179:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788744519.855538:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788744519.867728:0:18191:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744519.868198:0:18191:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788744520.821614:0:18241:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744520.821831:0:18241:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788744520.882056:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744521.904517:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744521.930255:0:18289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffe4303d0 20000000:00000080:2.0:1788744521.930280:0:18289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac745c0e400 uarg=0000000000000000 20000000:01000000:2.0:1788744521.930322:0:18289:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788744521.930330:0:18289:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788744521.930335:0:18289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788744521.931165:0:18290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788744521.931817:0:18289:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788744521.943380:0:18289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744521.943533:0:18289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.943551:0:18289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.943558:0:18289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.943564:0:18289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.943977:0:18289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.943993:0:18289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 17 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744521.944007:0:18289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18289:1875634154551936:0@lo:104: 00000100:00100000:2.0:1788744521.944065:0:18289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744521.944149:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154551936 00010000:00010000:2.0:1788744521.944150:0:18289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744521.944156:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154551936 00010000:00010000:2.0:1788744521.944158:0:18289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 17 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744521.944189:0:18289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18289:1875634154552064:0@lo:104: 00000100:00100000:0.0:1788744521.944203:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744521.944211:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:18289:x1875634154551936:12345-0@lo:104: 00000100:00100000:2.0:1788744521.944213:0:18289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744521.944223:0:18289:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7508c80c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788744521.944224:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944284:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744521.944290:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:18289:x1875634154551936:12345-0@lo:104: Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744521.944297:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744521.944312:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552064 00000100:00100000:0.0:1788744521.944321:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552064 00000100:00100000:0.0:1788744521.944335:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744521.944340:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:18289:x1875634154552064:12345-0@lo:104: 00010000:00010000:0.0:1788744521.944348:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944380:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788744521.944384:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:18289:x1875634154552064:12345-0@lo:104: Request processed in 44us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744521.944388:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788744521.944438:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744521.944443:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944450:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534000 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744521.944453:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944461:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744521.944468:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744521.944473:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744521.944497:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944504:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744521.944522:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944534:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534000/0xb6207a6e76dcd437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd43e expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944547:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744521.944551:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944557:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744521.944560:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944566:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744521.944571:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744521.944576:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744521.944590:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944595:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744521.944602:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944608:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd334 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd33b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944620:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744521.944627:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744521.944628:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744521.944648:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154552192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744521.944686:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744521.944708:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744521.944714:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154552320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744521.944733:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744521.944764:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552192 00000100:00100000:0.0:1788744521.944768:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552192 00010000:00010000:0.0:1788744521.944787:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 18 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744521.944806:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552320 00000100:00100000:0.0:1788744521.944809:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552320 00010000:00010000:0.0:1788744521.944819:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 19 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744521.944830:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744521.944836:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+19:3645:x1875634154552192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744521.944846:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744521.944850:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 19 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944859:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 19 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944871:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744521.944898:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+19:3645:x1875634154552192:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744521.944904:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744521.944925:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744521.944931:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+18:3645:x1875634154552320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744521.944938:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744521.944943:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 18 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944952:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 18 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944962:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944970:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944983:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944990:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.944996:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.945004:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.945009:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744521.945013:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.945019:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.945047:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744521.945055:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744521.945078:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+18:3645:x1875634154552320:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744521.945084:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744521.945130:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154552320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744521.945141:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154552192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744521.945361:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dac400/0xb6207a6e76dcd43e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd437 expref: 17 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744521.945373:0:18289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18289:1875634154551936:0@lo:104: 00010000:00010000:2.0:1788744521.945381:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd33b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd334 expref: 16 pid: 17132 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744521.945388:0:18289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18289:1875634154552064:0@lo:104: 00010000:00010000:2.0:1788744521.945420:0:18289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.945429:0:18289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.945435:0:18289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744521.945441:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b58800/0xb6207a6e76dcd492 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744521.952748:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744522.929552:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744523.515084:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788744523.635265:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744523.635275:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75575b800 from 13 10000000:01000000:2.0:1788744523.635281:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744523.635340:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744523.635364:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744523.635377:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744523.635438:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744523.635526:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744523.635586:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744523.635615:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552448 00000100:00100000:1.0:1788744523.635626:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552448 00000100:00100000:1.0:1788744523.635848:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744523.635870:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+16:17135:x1875634154552448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744523.635902:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744523.635924:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd499 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.635951:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.635962:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.635970:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741535400, rc 0) 00000100:00100000:1.0:1788744523.636042:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154552448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744523.636052:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788744523.638519:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744523.638557:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744523.638573:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744523.639215:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744523.639473:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744523.639529:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744523.640396:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552576 00000100:00100000:0.0:1788744523.640439:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552576 00000100:00100000:0.0:1788744523.640505:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744523.640516:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154552576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744523.640709:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154552576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744523.640717:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744523.640788:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744523.640845:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744523.640919:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744523.640950:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6435620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744523.640966:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552704 00000100:00100000:0.0:1788744523.640970:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552704 00000100:00100000:0.0:1788744523.640993:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744523.641000:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75310bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154552704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744523.641098:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75310bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154552704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744523.641105:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744523.641163:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744523.647375:0:18363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788744523.648041:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788744523.648080:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744523.648097:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.648123:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744523.648163:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744523.648168:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac641b52000 from 13 10000000:01000000:1.0:1788744523.648171:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744523.648225:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.648233:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.648257:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744523.648290:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744523.648379:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744523.648522:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7439380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744523.655042:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552832 00000100:00100000:3.0:1788744523.655065:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552832 00000100:00100000:3.0:1788744523.655228:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744523.655242:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+17:17135:x1875634154552832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744523.655272:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744523.655296:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd4a7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744523.655330:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744523.655343:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744523.655353:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437bfa00, rc 0) 00000100:00100000:3.0:1788744523.655495:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154552832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (7114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744523.655516:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744523.655637:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744523.655682:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744523.655693:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744523.655817:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744523.655857:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744523.657549:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154552960 00000100:00100000:0.0:1788744523.657567:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154552960 00000100:00100000:0.0:1788744523.657625:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744523.657638:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154552960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744523.657783:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744523.657866:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154552960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744523.657875:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744523.658221:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154552960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744523.658296:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154553088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744523.658359:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744523.658383:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744523.658447:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154553088 00000100:00100000:0.0:1788744523.658452:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154553088 00000100:00100000:0.0:1788744523.658489:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744523.658561:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75310b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154553088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744523.658658:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75310b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:17135:x1875634154553088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744523.658665:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744523.658730:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154553088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788744523.661452:0:18364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788744523.661534:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788744523.661566:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744523.661580:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744523.661594:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744523.951918:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744524.655120:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744514/real 1788744514] req@ffff9ac643e44e00 x1875634154547328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744524.655165:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e44e00 x1875634154547328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744524.655176:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744514/real 1788744514] req@ffff9ac643e46d80 x1875634154547200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744524.655188:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e46d80 x1875634154547200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744524.655211:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744524.655222:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788744524.655227:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154547328:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788744524.655232:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154553216:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788744524.655235:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac750724000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744524.655244:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788744524.655248:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154547200:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788744524.655564:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744524.655570:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744524.655574:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744524.655577:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744524.655609:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744524.655612:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788744524.655616:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac750724000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744524.655622:0:475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788744524.655629:0:475:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788744524.655641:0:475:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ac750724000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744524.655664:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e47b80 x1875634154553856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744524.655677:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744524.655680:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788744524.655681:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744524.655685:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788744524.655688:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788744524.655701:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ac751dc6000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744524.655714:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e45880 x1875634154553984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744524.655758:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154553472:0@lo:400:kworker.0 00000100:00100000:3.0:1788744524.655786:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744524.656059:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154553600:0@lo:400:kworker.0 00000100:00100000:1.0:1788744524.656137:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744524.656193:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154553600 00000100:00100000:1.0:1788744524.656204:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154553600 00000100:00100000:1.0:1788744524.656261:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744524.656271:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154553600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744524.656342:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154553600:12345-0@lo:400:kworker.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744524.656349:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788744524.656395:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643e44380 x1875634154553600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744524.656436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154553600:0@lo:400:kworker.0 00000100:00100000:3.0:1788744524.656958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154553728:0@lo:400:kworker.0 00000100:00100000:1.0:1788744524.658577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744524.662936:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744524.663192:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154553344:0@lo:400:kworker.0 00000100:00100000:2.0:1788744524.663295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744524.663343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154554112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744524.663383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744524.663544:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154553216 00000100:00100000:3.0:1788744524.663557:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154553216 00000100:00100000:3.0:1788744524.663615:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154553728 00000100:00100000:3.0:1788744524.663619:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154553728 00000100:00100000:3.0:1788744524.663640:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744524.663651:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154553216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744524.663702:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788744524.663816:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875634154553216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (8038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744524.663825:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744524.663847:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744524.663855:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154553728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744524.663901:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154553728:12345-0@lo:400:kworker.0 Request processed in 47us (6875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744524.663908:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744524.663958:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154553728:0@lo:400:kworker.0 00000100:00100000:3.0:1788744524.663979:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154553216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744524.664234:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154553344 00000100:00100000:2.0:1788744524.664241:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154553344 00000100:00100000:2.0:1788744524.664287:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744524.664296:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7628d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:3644:x1875634154553344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744524.664341:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7628d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:3644:x1875634154553344:12345-0@lo:400:kworker.0 Request processed in 46us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744524.664345:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154554240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744524.664352:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744524.664376:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744524.664391:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154553472 00000100:00100000:2.0:1788744524.664397:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154553472 00000100:00100000:1.0:1788744524.664463:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744524.664508:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154554240 00000100:00100000:2.0:1788744524.664513:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154554240 00000100:00100000:2.0:1788744524.664527:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744524.664533:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154553472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744524.664581:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875634154553472:12345-0@lo:400:kworker.0 Request processed in 47us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744524.664587:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744524.664599:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744524.664605:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154554240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744524.664626:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744524.664869:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154554112 00000100:00100000:3.0:1788744524.664876:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154554112 00000100:00100000:2.0:1788744524.664889:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154554240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 268us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744524.664903:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744524.664987:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154553856:0@lo:8:kworker.0 00000400:00000100:2.0:1788744524.665021:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154553856 offset 0 length 520: 4 00000100:00100000:1.0:1788744524.665438:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154553472:0@lo:400:kworker.0 00000100:00100000:2.0:1788744524.665760:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154553984:0@lo:8:kworker.0 00000100:00100000:3.0:1788744524.665774:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000400:00000100:2.0:1788744524.665800:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154553984 offset 0 length 520: 4 00000100:00100000:3.0:1788744524.665815:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154554112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744524.665899:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154553344:0@lo:400:kworker.0 00000100:00100000:3.0:1788744524.665976:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154554112:12345-0@lo:400:kworker.0 Request processed in 164us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744524.665985:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788744524.666005:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643e45500 x1875634154554112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744524.666018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154554112:0@lo:400:kworker.0 00000100:00100000:0.0:1788744524.668745:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154554240:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788744524.975884:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744525.176238:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788744525.681685:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744510/real 1788744510] req@ffff9ac643e91f80 x1875634154545152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744525.681727:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e91f80 x1875634154545152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744525.681737:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744510/real 1788744510] req@ffff9ac643e90a80 x1875634154545280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744525.681749:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e90a80 x1875634154545280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744525.681774:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744525.681806:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744525.681811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154545152:0@lo:8:kworker.0 00000100:00080000:3.0:1788744525.681817:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744525.681824:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744525.681827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154545280:0@lo:8:kworker.0 00000100:00080000:1.0:1788744525.681989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744525.681994:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788744525.681997:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744525.682003:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1788744525.682009:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744525.682023:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac643703800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744525.682046:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e44a80 x1875634154554624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744525.682055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744525.682070:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788744525.682071:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744525.682075:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1788744525.682078:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744525.682083:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac748bff000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744525.682107:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e44000 x1875634154554752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744525.682131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744525.682136:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744525.682138:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744525.682142:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744525.682173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154555008:0@lo:400:kworker.0 00000100:00100000:1.0:1788744525.682255:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744525.682292:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744525.682297:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154554368:0@lo:400:kworker.0 00000100:00100000:1.0:1788744525.682326:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744525.682354:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154555136:0@lo:400:kworker.0 00000100:00100000:1.0:1788744525.682379:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744525.682461:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555136 00000100:00100000:1.0:1788744525.682471:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555136 00000100:00100000:1.0:1788744525.682524:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744525.682534:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154555136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744525.682591:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154555136:12345-0@lo:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744525.682608:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788744525.682665:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643e44380 x1875634154555136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744525.682678:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154555136:0@lo:400:kworker.0 00000100:00100000:3.0:1788744525.683064:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154554624:0@lo:8:kworker.0 00000400:00000100:3.0:1788744525.683092:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154554624 offset 0 length 520: 4 00000100:00100000:3.0:1788744525.683126:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154554752:0@lo:8:kworker.0 00000400:00000100:3.0:1788744525.683143:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634154554752 offset 0 length 520: 4 00000100:00100000:3.0:1788744525.683169:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154554496:0@lo:400:kworker.0 00000100:00100000:3.0:1788744525.683205:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744525.683236:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744525.683242:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154554880:0@lo:400:kworker.0 00000100:00100000:3.0:1788744525.683263:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744525.683289:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154554368 00000100:00100000:3.0:1788744525.683293:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154554368 00000100:00100000:3.0:1788744525.683322:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744525.683329:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7628d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:3645:x1875634154554368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744525.683366:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7628d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+18:3645:x1875634154554368:12345-0@lo:400:kworker.0 Request processed in 37us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744525.683372:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744525.683421:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154554880 00000100:00100000:3.0:1788744525.683424:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154554880 00000100:00100000:3.0:1788744525.683445:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744525.683451:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154554880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744525.683480:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154554880:12345-0@lo:400:kworker.0 Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744525.683486:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788744525.683509:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643e46680 x1875634154554880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744525.683520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154554880:0@lo:400:kworker.0 00000100:00100000:3.0:1788744525.683543:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154554368:0@lo:400:kworker.0 00000100:00100000:2.0:1788744525.683865:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555008 00000100:00100000:2.0:1788744525.683870:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555008 00000100:00100000:2.0:1788744525.684027:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154554496 00000100:00100000:2.0:1788744525.684033:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154554496 00000100:00100000:2.0:1788744525.684052:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744525.684060:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154555008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744525.684127:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154555008:12345-0@lo:400:kworker.0 Request processed in 68us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744525.684134:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744525.684150:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744525.684157:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154554496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744525.684195:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154554496:12345-0@lo:400:kworker.0 Request processed in 39us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744525.684202:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744525.684243:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154554496:0@lo:400:kworker.0 00000100:00100000:2.0:1788744525.684281:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154555008:0@lo:400:kworker.0 00010000:00010000:0.0:1788744526.006251:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744526.511520:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788744527.024906:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744528.049904:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744529.049150:0:18638:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744529.049156:0:18638:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788744529.049158:0:18638:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788744529.049294:0:18638:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ac77cadb000 00000020:01000004:3.0:1788744529.049320:0:18638:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788744529.049536:0:18638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788744529.049556:0:18638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ac77b988000) 00000020:00000080:3.0:1788744529.049577:0:18638:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788744529.075051:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788744529.142270:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788744529.143234:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788744529.143748:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788744529.146900:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788744529.147642:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788744529.147958:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788744529.148324:0:18638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788744529.166662:0:18638:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788744529.168367:0:18638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788744529.168387:0:18638:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788744529.175372:0:18638:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb6207a6e76dcd4bc 00000020:01000004:0.0:1788744529.176560:0:18638:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788744529.176597:0:18638:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788744529.176601:0:18638:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788744529.176610:0:18638:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788744529.176615:0:18638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788744529.176633:0:18638:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ac6433c4d40) 00000020:00000080:0.0:1788744529.176651:0:18638:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788744529.180697:0:18638:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744529.180881:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788744529.180888:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788744529.185731:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744529.185749:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788744529.189051:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744529.189063:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788744529.190504:0:18638:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744529.190849:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744529.190855:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788744529.191983:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788744529.191993:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788744529.220242:0:18638:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744529.220598:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788744529.220606:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788744529.232098:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744529.232116:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788744529.235584:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744529.235598:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788744529.238034:0:18638:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744529.238232:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744529.238239:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788744529.241490:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788744529.241509:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788744529.280187:0:18638:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744529.280776:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744529.280786:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788744529.283330:0:18638:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788744529.283345:0:18638:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788744529.286170:0:18638:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788744529.286205:0:18638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788744529.286212:0:18638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788744529.314781:0:18638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744529.314837:0:18638:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788744529.314841:0:18638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744529.315052:0:18638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744529.315053:0:18638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744529.315054:0:18638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744529.315056:0:18638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744529.315057:0:18638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744529.315058:0:18638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744529.315060:0:18638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744529.315061:0:18638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744529.315064:0:18638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788744529.315066:0:18638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744529.315067:0:18638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744529.315068:0:18638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744529.315069:0:18638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744529.315079:0:18638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744529.315080:0:18638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744529.315081:0:18638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744529.315082:0:18638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744529.315083:0:18638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744529.315109:0:18638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788744529.315130:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744529.315207:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.315286:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75061d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.315327:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555264 00000100:00100000:1.0:1788744529.315335:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555264 00000100:00100000:1.0:1788744529.315448:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744529.315459:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:18638:x1875634154555264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744529.315497:0:17130:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788744529.315500:0:17130:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788744529.315505:0:17130:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788744529.317974:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:18638:x1875634154555264:12345-0@lo:253:mount.lustre.0 Request processed in 2507us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.318003:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744529.321927:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555264:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744529.321951:0:18638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788744529.321954:0:18638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744529.321956:0:18638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744529.321958:0:18638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744529.321959:0:18638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744529.321976:0:18638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744529.321978:0:18638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744529.321980:0:18638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744529.321981:0:18638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744529.321982:0:18638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744529.322007:0:18638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac77cadb000 from lustre-OST0000 10000000:01000000:3.0:1788744529.322042:0:18638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788744529.322045:0:18638:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788744529.322053:0:18638:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac643238000 local copy 00010000:00010000:3.0:1788744529.322065:0:18638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744529.322217:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744529.322286:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.322333:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744529.322585:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555392 00000100:00100000:2.0:1788744529.322593:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555392 00000100:00100000:2.0:1788744529.322641:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744529.322651:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:18638:x1875634154555392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744529.322781:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+18:18638:x1875634154555392:12345-0@lo:501:mount.lustre.0 Request processed in 130us (493us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744529.322789:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788744529.326677:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555392:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788744529.326857:0:18638:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788744529.326909:0:18638:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788744529.326919:0:18638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.326931:0:18638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744529.326964:0:18638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac77cadb000 10000000:01000000:0.0:1788744529.326982:0:18638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788744529.326988:0:18638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788744529.326991:0:18638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744529.326995:0:18638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788744529.326999:0:18638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744529.327037:0:18638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.327045:0:18638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.327056:0:18638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744529.327087:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744529.327150:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.327189:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7433dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.327249:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555520 00000100:00100000:1.0:1788744529.327256:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555520 00000100:00100000:1.0:1788744529.327358:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744529.327368:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+18:18638:x1875634154555520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744529.327381:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744529.327395:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcd4d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd4ca expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.327458:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcd4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4ca expref: 19 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.327467:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac741534000/0xb6207a6e76dcd4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4ca expref: 19 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.327475:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac741534000, rc 0) 00000100:00100000:1.0:1788744529.327519:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555520:12345-0@lo:101:mount.lustre.0 Request processed in 153us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.327526:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788744529.327612:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744529.327625:0:18638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4d1 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744529.327634:0:18638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd4d1 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744529.332028:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788744529.332707:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744529.334836:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788744529.334895:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788744529.334914:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788744529.334928:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788744529.334941:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788744529.334957:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788744529.334983:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788744529.334989:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788744529.336701:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744529.336801:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.336885:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.342790:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555648 00000100:00100000:0.0:1788744529.342805:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555648 00000100:00100000:0.0:1788744529.342879:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744529.342891:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744529.343635:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555648:12345-0@lo:501:mount.lustre.0 Request processed in 743us (6830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.343645:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744529.349454:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744529.349520:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744529.349599:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.349706:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.352999:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555776 00000100:00100000:1.0:1788744529.353016:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555776 00000100:00100000:2.0:1788744529.353156:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744529.353167:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744529.356080:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555776:12345-0@lo:503:mount.lustre.0 Request processed in 2884us (6451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.356100:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788744529.360626:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744529.364283:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744529.364545:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.364657:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.364715:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6431e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.364728:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154555904 00000100:00100000:0.0:1788744529.364738:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154555904 00000100:00100000:0.0:1788744529.364805:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744529.364815:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744529.365750:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154555904:12345-0@lo:502:mount.lustre.0 Request processed in 860us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.365781:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788744529.365923:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154555904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744529.366398:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788744529.366476:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788744529.366494:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788744529.366512:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788744529.366523:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788744529.366537:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788744529.366552:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788744529.366571:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788744529.366586:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788744529.366599:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788744529.366613:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788744529.366628:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788744529.366670:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.366753:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.366799:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.369367:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556032 00000100:00100000:1.0:1788744529.369386:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556032 00000100:00100000:1.0:1788744529.369477:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788744529.369491:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154556032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744529.369976:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154556032:12345-0@lo:502:mount.lustre.0 Request processed in 487us (3220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.369986:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744529.370120:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744529.370208:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788744529.370222:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788744529.375749:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744529.375761:0:18655:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788744529.375768:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.375770:0:18655:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788744529.375779:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744529.375795:0:18655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ac6433c19c0) 00000020:00000080:0.0:1788744529.375823:0:18655:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788744529.375828:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744529.375947:0:18655:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac77cadb000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788744529.375960:0:18655:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744529.375970:0:18655:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb6207a6e76dcd4df 00010000:00010000:0.0:1788744529.385279:0:18655:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788744529.385767:0:18655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788744529.388346:0:18655:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788744529.390278:0:18655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788744529.390290:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744529.390297:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.390299:0:18655:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788744529.390302:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788744529.390306:0:18655:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788744529.390307:0:18655:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788744529.390308:0:18655:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788744529.390310:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788744529.390313:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.390314:0:18655:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788744529.390317:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744529.390320:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.390330:0:18655:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744529.390334:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744529.390336:0:18655:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788744529.390339:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744529.390341:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.390342:0:18655:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788744529.390345:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744529.390347:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.390348:0:18655:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744529.390351:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788744529.390377:0:18655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744529.390380:0:18655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744529.390381:0:18655:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788744529.390384:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788744529.390636:0:18638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788744529.390664:0:18638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788744529.390798:0:18638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4d1 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744529.390812:0:18638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dacc00/0xb6207a6e76dcd4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4d1 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744529.390820:0:18638:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac77cadb000 from 1 10000000:01000000:3.0:1788744529.390823:0:18638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744529.390858:0:18638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744529.390866:0:18638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744529.390980:0:18638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744529.391007:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744529.391094:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.391138:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.391321:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556160 00000100:00100000:0.0:1788744529.391330:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556160 00000100:00100000:0.0:1788744529.391385:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744529.391437:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+19:18638:x1875634154556160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744529.391452:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744529.391465:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd4e6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.391489:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 20 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.391500:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 20 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.391508:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad000, rc 0) 00000100:00100000:0.0:1788744529.391546:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556160:12345-0@lo:101:mount.lustre.0 Request processed in 112us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.391552:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744529.392058:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744529.392084:0:18638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744529.392094:0:18638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744529.393352:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788744529.394023:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744529.394245:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788744529.394273:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788744529.394314:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788744529.394321:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788744529.396382:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744529.396557:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.396641:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.399147:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556288 00000100:00100000:0.0:1788744529.399161:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556288 00000100:00100000:0.0:1788744529.399218:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744529.399228:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744529.399418:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556288:12345-0@lo:501:mount.lustre.0 Request processed in 165us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.399426:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744529.399668:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744529.399803:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744529.399855:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.399891:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa4cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.399941:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556416 00000100:00100000:1.0:1788744529.399953:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556416 00000100:00100000:1.0:1788744529.399985:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744529.399992:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744529.400082:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556416:12345-0@lo:503:mount.lustre.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.400088:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744529.400180:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556416:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744529.400596:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744529.400666:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.400910:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.400946:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa4cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.400997:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556544 00000100:00100000:1.0:1788744529.401003:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556544 00000100:00100000:1.0:1788744529.401036:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744529.401043:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744529.401143:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556544:12345-0@lo:502:mount.lustre.0 Request processed in 99us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.401150:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788744529.401228:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744529.401456:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788744529.401485:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788744529.401506:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788744529.401520:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788744529.401535:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788744529.401553:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788744529.401567:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788744529.401581:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788744529.401598:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788744529.401613:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788744529.401626:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788744529.401650:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744529.401846:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.401877:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744529.401952:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556672 00000100:00100000:2.0:1788744529.401959:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556672 00000100:00100000:2.0:1788744529.402000:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744529.402009:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.402127:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556672:12345-0@lo:502:mount.lustre.0 Request processed in 119us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.402134:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744529.402269:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744529.402317:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788744529.402325:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788744529.408905:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744529.408920:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.408923:0:18659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744529.408930:0:18659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac77cadb000 00000020:00000080:3.0:1788744529.408933:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744529.408940:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744529.408943:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.408944:0:18659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788744529.408946:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744529.408948:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.408950:0:18659:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744529.408954:0:18659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac77cadb000 00000020:00000080:3.0:1788744529.408967:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744529.409025:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744529.409028:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.409030:0:18659:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788744529.409032:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744529.409035:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.409036:0:18659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744529.409039:0:18659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac77cadb000 00000020:00000080:3.0:1788744529.409041:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744529.409060:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744529.409063:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.409064:0:18659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744529.409066:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744529.409068:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.409078:0:18659:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788744529.409083:0:18659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac77cadb000 00000020:00000080:3.0:1788744529.409086:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744529.409109:0:18659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744529.409112:0:18659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744529.409113:0:18659:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788744529.409116:0:18659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788744529.412981:0:18638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788744529.413032:0:18638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744529.413062:0:18638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.413091:0:18638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744529.413172:0:18638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788744529.413175:0:18638:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac77cadb000 10000000:01000000:0.0:1788744529.413179:0:18638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac77cadb000 10000000:01000000:0.0:1788744529.413182:0:18638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744529.413188:0:18638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac77cadb000 from 1 10000000:01000000:0.0:1788744529.413191:0:18638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744529.413227:0:18638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.413234:0:18638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.413245:0:18638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744529.413268:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744529.413329:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.413361:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744529.413448:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556800 00000100:00100000:2.0:1788744529.413456:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556800 00000100:00100000:2.0:1788744529.413505:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744529.413515:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:18638:x1875634154556800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744529.413531:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744529.413543:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b59200/0xb6207a6e76dcd4fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd4f4 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744529.413564:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b59200/0xb6207a6e76dcd4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4f4 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744529.413573:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b59200/0xb6207a6e76dcd4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4f4 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744529.413582:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59200, rc 0) 00000100:00100000:2.0:1788744529.413619:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154556800:12345-0@lo:101:mount.lustre.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.413626:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744529.413857:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744529.413871:0:18638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4fb expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.413879:0:18638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd4fb expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744529.415365:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788744529.415646:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744529.415987:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788744529.416014:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788744529.416032:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788744529.416046:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788744529.416058:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788744529.416083:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788744529.416101:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788744529.416115:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788744529.416129:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788744529.416140:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788744529.416153:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788744529.416167:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788744529.416180:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788744529.416194:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788744529.416221:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788744529.416236:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788744529.416251:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788744529.416263:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788744529.416276:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788744529.416290:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788744529.416304:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788744529.416319:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788744529.416333:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788744529.416348:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788744529.416361:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788744529.416374:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788744529.416528:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788744529.416548:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788744529.416562:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788744529.416587:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788744529.416614:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788744529.416630:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788744529.416645:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788744529.416658:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788744529.416672:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788744529.416949:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788744529.416970:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788744529.416993:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788744529.416998:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788744529.417095:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744529.417156:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.417198:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154556928 00000100:00100000:0.0:1788744529.417205:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154556928 00000100:00100000:0.0:1788744529.417248:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744529.417257:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154556928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744529.417364:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154556928:12345-0@lo:501:mount.lustre.0 Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.417371:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744529.418618:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.418650:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154556928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744529.418827:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744529.418939:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.418965:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.419048:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557056 00000100:00100000:1.0:1788744529.419055:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557056 00000100:00100000:1.0:1788744529.419100:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744529.419109:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744529.419221:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557056:12345-0@lo:503:mount.lustre.0 Request processed in 113us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.419228:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788744529.421854:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557056:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744529.422323:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744529.422785:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744529.422927:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.422973:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557184 00000100:00100000:0.0:1788744529.422979:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557184 00000100:00100000:0.0:1788744529.423025:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788744529.423034:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.423570:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.425231:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557184:12345-0@lo:502:mount.lustre.0 Request processed in 2192us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.425302:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744529.431830:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744529.432114:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788744529.432153:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788744529.432174:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788744529.432206:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788744529.432234:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788744529.432248:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788744529.432265:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788744529.432282:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788744529.432295:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788744529.432308:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788744529.432321:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788744529.432338:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788744529.432350:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788744529.432364:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788744529.432378:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788744529.433537:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788744529.433583:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788744529.433598:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788744529.433612:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788744529.433643:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788744529.433660:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788744529.433674:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788744529.433785:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788744529.433806:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788744529.433821:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788744529.433835:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788744529.433849:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788744529.433862:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788744529.433877:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788744529.433892:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788744529.433907:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788744529.433922:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788744529.433947:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788744529.433962:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788744529.433982:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788744529.434014:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788744529.434035:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788744529.434050:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788744529.434068:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788744529.434100:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788744529.434115:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788744529.434133:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788744529.434149:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788744529.434163:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788744529.434176:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788744529.434192:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788744529.434205:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788744529.434219:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788744529.434275:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.434348:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.434551:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744529.437799:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557312 00000100:00100000:1.0:1788744529.437815:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557312 00000100:00100000:1.0:1788744529.438574:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744529.438587:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744529.438754:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557312:12345-0@lo:502:mount.lustre.0 Request processed in 170us (4405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.438770:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788744529.441202:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744529.441805:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788744529.441833:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788744529.442171:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744529.442245:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.442303:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77aa783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.443809:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557440 00000100:00100000:0.0:1788744529.443822:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557440 00000100:00100000:0.0:1788744529.443880:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788744529.443891:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744529.444055:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154557440:12345-0@lo:502:mount.lustre.0 Request processed in 165us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.444062:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744529.444721:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154557440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744529.444800:0:18638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788744529.444815:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788744529.445996:0:18664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788744529.446018:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ac776c299c0) 00000020:00000080:2.0:1788744529.446041:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788744529.446126:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac77cadb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788744529.446130:0:18664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac77cadb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788744529.446132:0:18664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac77cadb000 3 00010000:00080000:2.0:1788744529.446176:0:18664:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac775e85800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788744529.447756:0:18664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788744529.447928:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788744529.447967:0:18664:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788744529.447980:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb6207a6e76dcd509 00000100:00080000:2.0:1788744529.447989:0:18664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744529.448000:0:18664:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac775e85800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744529.448037:0:18664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643354700 x1875634154557568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744529.448066:0:18664:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788744529.448104:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154557568:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788744529.448116:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744529.448120:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744529.448122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744529.448125:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744529.448145:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744529.448148:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744529.448151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744529.448154:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744529.448172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.448181:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154557696:0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.448211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744529.448228:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557568 00000100:00100000:1.0:1788744529.448235:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557568 00000100:00100000:1.0:1788744529.448267:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744529.448274:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875634154557568:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788744529.448298:0:17138:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:1.0:1788744529.448326:0:17138:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb6207a6e76dcd510 00000004:00100000:1.0:1788744529.448338:0:17138:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744529.448369:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9ac77cad9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744529.448445:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875634154557568:12345-0@lo:38:llog_process_th.0 Request processed in 169us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.448453:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788744529.448490:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643354700 x1875634154557568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744529.448499:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744529.448505:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788744529.448511:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788744529.448515:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744529.448517:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac775e85800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744529.448522:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875634154557568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788744529.448875:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744529.448882:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154557824:0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.448920:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.448954:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154557952:0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.448976:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.449002:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744529.449008:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154558080:0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.449028:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.449058:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557696 00000100:00100000:2.0:1788744529.449062:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557696 00000100:00100000:2.0:1788744529.449101:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557952 00000100:00100000:2.0:1788744529.449104:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557952 00000100:00100000:1.0:1788744529.449110:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744529.449118:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744529.449119:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154557696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.449123:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154557952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.449162:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154557952:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.449162:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154557696:12345-0@lo:400:kworker.0 Request processed in 44us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.449169:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744529.449190:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154557824 00000100:00100000:2.0:1788744529.449194:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154557824 00000100:00100000:2.0:1788744529.449213:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558080 00000100:00100000:2.0:1788744529.449216:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558080 00000100:00100000:1.0:1788744529.449223:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744529.449228:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744529.449234:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154557824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744529.449241:0:17137:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788744529.449247:0:17137:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788744529.449261:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154557824:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.449267:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744529.449279:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744529.449284:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154558080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.449325:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154558080:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.449332:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788744529.449346:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643357b80 x1875634154557824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788744529.449353:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643357100 x1875634154558080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744529.449357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154557824:0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.449361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154558080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744529.449366:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154557696:0@lo:400:kworker.0 00000100:00100000:2.0:1788744529.449369:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154557952:0@lo:400:kworker.0 00000020:01000004:3.0:1788744529.453471:0:18664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788744529.453489:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ac77b9899c0) 00000020:00000080:3.0:1788744529.453513:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788744529.453582:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac77cadb000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788744529.453587:0:18664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac77cadb000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788744529.453590:0:18664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac77cadb000 3 00010000:00080000:3.0:1788744529.453626:0:18664:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac774b61800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788744529.459642:0:18664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788744529.461466:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788744529.461516:0:18664:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744529.461530:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb6207a6e76dcd51e 00000100:00080000:3.0:1788744529.461548:0:18664:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744529.461563:0:18664:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ac774b61800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788744529.461600:0:18664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e90380 x1875634154558208/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744529.461629:0:18664:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788744529.461664:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744529.461670:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744529.461673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744529.461677:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744529.461971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744529.461975:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744529.461977:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744529.461980:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788744529.462494:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875634154558208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744529.462567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.462630:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558208 00000100:00100000:3.0:1788744529.462637:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558208 00000100:00100000:3.0:1788744529.462669:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744529.462677:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154558208:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788744529.462716:0:17139:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1788744529.462748:0:17139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb6207a6e76dcd525 00000004:00100000:3.0:1788744529.462762:0:17139:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788744529.462793:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9ac774b67000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744529.462853:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875634154558208:12345-0@lo:38:llog_process_th.0 Request processed in 175us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744529.462861:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788744529.463029:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac643e90380 x1875634154558208/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744529.463040:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744529.463047:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788744529.463054:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788744529.463058:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788744529.463060:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac774b61800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788744529.463065:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875634154558208:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788744529.467970:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788744529.468177:0:18638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788744529.468211:0:18638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744529.468229:0:18638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4fb expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744529.468241:0:18638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dac600/0xb6207a6e76dcd4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd4fb expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744529.468295:0:18638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744529.468297:0:18638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744529.468299:0:18638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744529.468300:0:18638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744529.468301:0:18638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744529.468302:0:18638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744529.468304:0:18638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744529.468306:0:18638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744529.468307:0:18638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744529.468311:0:18638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788744529.468314:0:18638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744529.468315:0:18638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744529.468316:0:18638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744529.468317:0:18638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744529.468318:0:18638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744529.468319:0:18638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744529.468325:0:18638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744529.468325:0:18638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744529.468326:0:18638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744529.468354:0:18638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788744529.468374:0:18638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154558336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744529.468813:0:18638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.468858:0:18638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac743938e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.469450:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558336 00000100:00100000:0.0:1788744529.469460:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558336 00000100:00100000:0.0:1788744529.469508:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788744529.469517:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154558336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744529.469543:0:17131:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788744529.469558:0:17131:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788744529.475833:0:17131:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788744529.475850:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788744529.476088:0:17153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788744529.476093:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788744529.476116:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.476135:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 21 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.476143:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.476151:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.476191:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.476205:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 21 pid: 17131 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744529.476231:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154558464:0@lo:104: 00000100:00100000:1.0:1788744529.476293:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744529.476340:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 21 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.476348:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 21 pid: 17130 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744529.476356:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154558592:0@lo:104: 00000100:00100000:1.0:1788744529.476382:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744529.476845:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75068a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744529.477176:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788744529.477196:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558464 00000100:00100000:0.0:1788744529.477203:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558464 00000100:00100000:0.0:1788744529.477239:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558592 00000100:00100000:0.0:1788744529.477241:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558592 00000100:00100000:0.0:1788744529.477266:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744529.477274:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154558464:12345-0@lo:104: 00010000:00010000:0.0:1788744529.477285:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.477352:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744529.477357:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154558464:12345-0@lo:104: Request processed in 85us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.477363:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744529.477378:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744529.477383:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d497050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:17153:x1875634154558592:12345-0@lo:104: 00000100:00100000:1.0:1788744529.477516:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:18638:x1875634154558336:12345-0@lo:253:mount.lustre.0 Request processed in 8000us (8704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.477524:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788744529.478200:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154558464:0@lo:104: 00000100:00100000:2.0:1788744529.478241:0:18638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:18638:1875634154558336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744529.478253:0:18638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788744529.478256:0:18638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744529.478257:0:18638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744529.478259:0:18638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744529.478260:0:18638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744529.478261:0:18638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744529.478262:0:18638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744529.478263:0:18638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744529.478265:0:18638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744529.478267:0:18638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788744529.478281:0:18638:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788744529.478553:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.478605:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788744529.478612:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d497050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+3:17153:x1875634154558592:12345-0@lo:104: Request processed in 1228us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744529.478619:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788744529.478659:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744529.478665:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.478672:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad600 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744529.478675:0:17125:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.478683:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744529.478799:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154558592:0@lo:104: 00010000:00010000:1.0:1788744529.478819:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744529.479519:0:17125:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744529.479525:0:17125:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744529.479566:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479572:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744529.479595:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479601:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac643dad600/0xb6207a6e76dcd47d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd484 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479612:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744529.479616:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479622:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad200 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:0.0:1788744529.479625:0:17125:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479633:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744529.479639:0:17125:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744529.479645:0:17125:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744529.479664:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479670:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744529.479676:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479759:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac643dad200/0xb6207a6e76dcd46f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd476 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744529.479772:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744529.479774:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744529.479776:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744529.479784:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744529.479799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154558720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744529.479847:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744529.480030:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744529.480037:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154558848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744529.480064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744529.480352:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558720 00000100:00100000:1.0:1788744529.480359:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558720 00010000:00010000:1.0:1788744529.480387:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 21 pid: 17131 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744529.480438:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558848 00000100:00100000:1.0:1788744529.480441:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558848 00010000:00010000:1.0:1788744529.480452:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 22 pid: 17130 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744529.480481:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744529.480487:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+22:3643:x1875634154558720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744529.480501:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744529.480507:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 22 pid: 17131 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480518:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 22 pid: 17131 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480534:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd47d expref: 22 pid: 17131 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480550:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744529.480597:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+21:3643:x1875634154558720:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.480605:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744529.480626:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744529.480632:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7616f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+20:3643:x1875634154558848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744529.480640:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744529.480643:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 20 pid: 17130 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480651:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 20 pid: 17130 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480660:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437bf400/0xb6207a6e76dcd476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd46f expref: 20 pid: 17130 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480692:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480700:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744529.480713:0:17122:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004621316s 00010000:00010000:1.0:1788744529.480719:0:17122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480725:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480731:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480737:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480743:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744529.480747:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480753:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480767:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.480776:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744529.480808:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7616f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3734829d-853b-494e-83d0-e0bd2808e668+19:3643:x1875634154558848:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744529.480814:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788744529.480866:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.482028:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744529.482036:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741534a00/0xb6207a6e76dcd52c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744529.483290:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154558848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744529.483307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154558720:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788744529.490148:0:18638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788744529.497263:0:18638:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788744529.497273:0:18638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788744529.497312:0:18638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788744529.497358:0:18638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788744529.497376:0:18638:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788744529.497398:0:18638:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788744529.498672:0:18638:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744529.499128:0:18638:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788744529.777089:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744529.777121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154558976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744529.777222:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744529.777283:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154558976 00000100:00100000:2.0:1788744529.777293:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154558976 00000100:00100000:2.0:1788744529.777362:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744529.777373:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154558976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744529.777441:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788744529.777493:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154558976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744529.777501:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744529.777585:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154558976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744529.777825:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744529.777836:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154559104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744529.777885:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744529.778018:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559104 00000100:00100000:3.0:1788744529.778025:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559104 00000100:00100000:3.0:1788744529.778060:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744529.778078:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154559104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744529.778103:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744529.778147:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154559104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744529.778154:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744529.778187:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154559104:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744530.094591:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788744530.349187:0:18718:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744530.349604:0:18718:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744531.118659:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788744531.374525:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744531.374533:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75575b800 from 9 10000000:01000000:1.0:1788744531.374538:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744531.374583:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744531.374595:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744531.374607:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744531.374644:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744531.374712:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744531.374761:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744531.375050:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559232 00000100:00100000:0.0:1788744531.375069:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559232 00000100:00100000:0.0:1788744531.375134:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788744531.375144:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+19:17135:x1875634154559232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744531.375158:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744531.375172:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd533 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.375194:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 20 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.375205:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 20 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.375215:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad800, rc 0) 00000100:00100000:0.0:1788744531.375253:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+20:17135:x1875634154559232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744531.375261:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744531.375382:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744531.375398:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744531.375553:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744531.375608:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788744531.375643:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744531.375672:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744531.375986:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559360 00000100:00100000:0.0:1788744531.375991:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559360 00000100:00100000:0.0:1788744531.376026:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788744531.376034:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+20:17135:x1875634154559360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744531.376049:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744531.376075:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744531.376078:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788744531.376168:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+20:17135:x1875634154559360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744531.376177:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788744531.376249:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788744531.376309:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744531.376317:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744531.376336:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744531.376346:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744531.376348:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac641b52000 from 9 10000000:01000000:3.0:1788744531.376350:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744531.376371:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744531.376379:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744531.376388:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744531.376432:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744531.376460:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744531.376477:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744531.376594:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559488 00000100:00100000:0.0:1788744531.376600:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559488 00000100:00100000:0.0:1788744531.376626:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788744531.376639:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:17135:x1875634154559488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744531.376648:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744531.376657:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd541 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.376675:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.376684:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.376690:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac200, rc 0) 00000100:00100000:0.0:1788744531.376719:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154559488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744531.376725:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788744531.376769:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744531.376779:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.376787:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744531.376827:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744531.376855:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744531.376886:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77a9c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744531.376897:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559616 00000100:00100000:0.0:1788744531.376900:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559616 00000100:00100000:0.0:1788744531.376920:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744531.376933:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154559616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744531.376945:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744531.376957:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744531.376960:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788744531.377027:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154559616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744531.377034:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744531.377073:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154559616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744531.377111:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744531.377117:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744531.377125:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744532.142605:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744533.166615:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744533.743038:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744534.193143:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744534.901336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744534.901343:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744534.901346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744534.901349:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744534.901366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744534.901370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744534.901372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744534.901375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744534.901474:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154560128:0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.902918:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744534.902996:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154560640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903076:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744534.903104:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744534.903111:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154560000:0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903163:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744534.903197:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154560512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744534.903256:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560128 00000100:00100000:1.0:1788744534.903263:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560128 00000100:00100000:1.0:1788744534.903322:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560640 00000100:00100000:1.0:1788744534.903327:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560640 00000100:00100000:1.0:1788744534.903349:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560512 00000100:00100000:1.0:1788744534.903352:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560512 00000100:00100000:1.0:1788744534.903368:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744534.903375:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154560128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903448:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154560128:12345-0@lo:400:kworker.0 Request processed in 72us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744534.903454:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744534.903471:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744534.903477:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154560640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903503:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154560640:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744534.903508:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744534.903518:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744534.903523:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154560512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903567:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154560512:12345-0@lo:400:kworker.0 Request processed in 43us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744534.903574:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744534.903600:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560000 00000100:00100000:1.0:1788744534.903603:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560000 00000100:00100000:1.0:1788744534.903629:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744534.903635:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154560000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.903666:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154560000:12345-0@lo:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744534.903673:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788744534.903706:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744534.903711:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744534.903736:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154560000:0@lo:400:kworker.0 00010000:00080000:1.0:1788744534.903749:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643354000 x1875634154560512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744534.903758:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154560512:0@lo:400:kworker.0 00010000:00080000:1.0:1788744534.903767:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e46680 x1875634154560128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744534.903774:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154560128:0@lo:400:kworker.0 00010000:00080000:1.0:1788744534.903782:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643355880 x1875634154560640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744534.903788:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154560640:0@lo:400:kworker.0 00000100:00100000:0.0:1788744534.904016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154559744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744534.904077:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744534.904105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154560256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744534.904124:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744534.904179:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154560768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744534.904205:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744534.908248:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744534.908268:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154559872:0@lo:400:kworker.0 00000100:00100000:0.0:1788744534.908343:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744534.908374:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154560384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744534.908416:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744534.908456:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559872 00000100:00100000:0.0:1788744534.908464:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559872 00000100:00100000:0.0:1788744534.908508:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788744534.908518:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:3643:x1875634154559872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744534.908567:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:3643:x1875634154559872:12345-0@lo:400:kworker.0 Request processed in 50us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744534.908574:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788744534.908621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154559872:0@lo:400:kworker.0 00000100:00100000:2.0:1788744534.915304:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154559744 00000100:00100000:2.0:1788744534.915319:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154559744 00000100:00100000:2.0:1788744534.915368:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560256 00000100:00100000:2.0:1788744534.915371:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560256 00000100:00100000:2.0:1788744534.915380:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560768 00000100:00100000:2.0:1788744534.915383:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560768 00000100:00100000:2.0:1788744534.915398:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744534.915421:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154559744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744534.915456:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788744534.915583:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154559744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (11504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744534.915590:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744534.915609:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744534.915616:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154560256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744534.915648:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154560256:12345-0@lo:400:kworker.0 Request processed in 33us (11523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744534.915655:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744534.915666:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744534.915672:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154560768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744534.915688:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788744534.915733:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154560768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (11526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744534.915739:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744534.915855:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154559744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744534.915866:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154560256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744534.915879:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154560768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744534.916937:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560384 00000100:00100000:1.0:1788744534.916946:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560384 00000100:00100000:1.0:1788744534.916994:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744534.917003:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154560384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744534.917070:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154560384:12345-0@lo:400:kworker.0 Request processed in 69us (8666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744534.917076:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788744534.917178:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e46a00 x1875634154560384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744534.917197:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154560384:0@lo:400:kworker.0 00010000:00010000:0.0:1788744535.215381:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744535.348698:0:19008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744536.239673:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788744536.260823:0:19060:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744536.261134:0:19060:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788744536.756291:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788744537.064717:0:19110:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744537.064919:0:19110:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788744537.262666:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744538.287189:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744539.313611:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744539.694500:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744524/real 1788744524] req@ffff9ac643e47b80 x1875634154553856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744539.694527:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e47b80 x1875634154553856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744539.694537:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744524/real 1788744524] req@ffff9ac643e45880 x1875634154553984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744539.694561:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e45880 x1875634154553984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744539.694590:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac750724000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744539.694598:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744539.694602:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154553856:0@lo:8:kworker.0 00000100:00080000:3.0:1788744539.694607:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744539.694613:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744539.694615:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154553984:0@lo:8:kworker.0 00000100:00080000:1.0:1788744539.694926:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744539.694931:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744539.694933:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744539.694936:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744539.695089:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744539.695092:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788744539.695095:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac750724000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744539.695100:0:475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:1.0:1788744539.695105:0:475:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744539.695115:0:475:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ac750724000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744539.695134:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643357b80 x1875634154561408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744539.695147:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744539.695149:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788744539.695151:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744539.695154:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:1.0:1788744539.695157:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788744539.695161:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ac751dc6000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744539.695173:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643e45880 x1875634154561536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744539.695219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154560896:0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.695278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744539.695317:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154561664:0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.695341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744539.695359:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744539.695364:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154561280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.695384:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744539.695603:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154561408:0@lo:8:kworker.0 00000100:00100000:3.0:1788744539.695633:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744539.695664:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154561536:0@lo:8:kworker.0 00000100:00100000:3.0:1788744539.695682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744539.695732:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561408 00000100:00100000:3.0:1788744539.695739:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561408 00000100:00100000:3.0:1788744539.695763:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561536 00000100:00100000:3.0:1788744539.695766:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561536 00000100:00100000:3.0:1788744539.695792:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744539.695798:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875634154561408:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788744539.695826:0:18644:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1788744539.695854:0:18644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd54f 00002000:00100000:3.0:1788744539.695866:0:18644:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ac774b65800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788744539.695870:0:18644:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788744539.695874:0:18644:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788744539.696210:0:18644:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788744539.696234:0:18644:0:(import.c:65:import_set_state_nolock()) ffff9ac774b64000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744539.696282:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875634154561408:12345-0@lo:8:kworker.0 Request processed in 482us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744539.696289:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744539.696317:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744539.696322:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875634154561536:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788744539.696334:0:18644:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744539.696690:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154561024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.696727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744539.696752:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154561792:0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.696789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744539.696812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788744539.696818:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154561152:0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.696838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744539.696856:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154561920:0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.696891:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744539.696919:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561280 00000100:00100000:2.0:1788744539.696924:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561280 00000100:00100000:1.0:1788744539.697236:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154560896 00000100:00100000:1.0:1788744539.697241:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154560896 00000100:00100000:1.0:1788744539.697272:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744539.697279:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:3644:x1875634154560896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.697325:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:3644:x1875634154560896:12345-0@lo:400:kworker.0 Request processed in 47us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744539.697331:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744539.697361:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561664 00000100:00100000:1.0:1788744539.697365:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561664 00000100:00100000:1.0:1788744539.697382:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561792 00000100:00100000:1.0:1788744539.697385:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561792 00000100:00100000:1.0:1788744539.697422:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561152 00000100:00100000:1.0:1788744539.697425:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561152 00000100:00100000:1.0:1788744539.697437:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561920 00000100:00100000:1.0:1788744539.697439:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561920 00000100:00100000:1.0:1788744539.697454:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744539.697459:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154561664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.697491:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154561664:12345-0@lo:400:kworker.0 Request processed in 31us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744539.697511:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744539.697524:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744539.697530:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154561792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.697660:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154561024 00000100:00100000:2.0:1788744539.697665:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154561024 00000100:00100000:2.0:1788744539.697683:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744539.697689:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154561280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.697723:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154561280:12345-0@lo:400:kworker.0 Request processed in 34us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744539.697728:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744539.697742:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744539.697748:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154561024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.697775:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154561024:12345-0@lo:400:kworker.0 Request processed in 27us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744539.698663:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744539.698703:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744539.698711:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154561152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.698765:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154561152:12345-0@lo:400:kworker.0 Request processed in 55us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744539.698771:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744539.700109:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154561792:12345-0@lo:400:kworker.0 Request processed in 35us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744539.700123:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744539.700198:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744539.700215:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154561920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.700301:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154561920:12345-0@lo:400:kworker.0 Request processed in 94us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744539.700307:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788744539.700371:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643357800 x1875634154561152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744539.700386:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154561152:0@lo:400:kworker.0 00010000:00080000:2.0:1788744539.700414:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e44700 x1875634154561920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744539.700424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154561920:0@lo:400:kworker.0 00000100:00100000:2.0:1788744539.700439:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154561024:0@lo:400:kworker.0 00010000:00080000:2.0:1788744539.700452:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e46a00 x1875634154561792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744539.700459:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154561792:0@lo:400:kworker.0 00010000:00080000:2.0:1788744539.700553:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643357b80 x1875634154561408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744539.700590:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744539.700599:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788744539.700608:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788744539.700614:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788744539.700618:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac750724000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788744539.700642:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788744539.700649:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154561408:0@lo:8:kworker.0 00000004:00080000:2.0:1788744539.700674:0:17879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788744539.700767:0:17879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 521382364280ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788744539.700773:0:17879:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1788744539.702016:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788744539.702025:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788744539.702084:0:17880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788744539.702110:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875634154562176:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788744539.702174:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744539.702201:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744539.702217:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154562048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744539.702243:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744539.702300:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154561280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.702312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154560896:0@lo:400:kworker.0 00010000:00080000:1.0:1788744539.702325:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e47b80 x1875634154561664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744539.702335:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154561664:0@lo:400:kworker.0 00000100:00100000:1.0:1788744539.702385:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562048 00000100:00100000:1.0:1788744539.702392:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562048 00000100:00100000:1.0:1788744539.702456:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744539.702465:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154562048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744539.702492:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788744539.702546:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875634154562048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744539.702553:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788744539.704936:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744539.704993:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e45f80 x1875634154562048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744539.705028:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154562048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744539.705148:0:18642:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788744539.705156:0:18642:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788744539.705250:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562176 00000100:00100000:1.0:1788744539.705257:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562176 00000100:00100000:1.0:1788744539.705348:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744539.705357:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17880:x1875634154562176:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788744539.716322:0:17870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788744539.723115:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875634154561536:12345-0@lo:8:kworker.0 Request processed in 26782us (27422us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744539.723129:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788744539.723186:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744539.723191:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744539.723195:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154561536:0@lo:8:kworker.0 00002000:00080000:2.0:1788744539.735366:0:19228:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788744539.735383:0:19228:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788744539.735530:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17880:x1875634154562176:12345-0@lo:7:osp-pre-0-1.0 Request processed in 30167us (33349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744539.735551:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788744539.735606:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e46a00 x1875634154562176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744555 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744539.735627:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e46a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875634154562176:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788744539.735643:0:17880:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788744539.735706:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875634154562304:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788744539.736091:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744539.736147:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac747617240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744539.736238:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562304 00000100:00100000:2.0:1788744539.736249:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562304 00000100:00100000:2.0:1788744539.736342:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744539.736360:0:18642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17880:x1875634154562304:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788744539.736439:0:18642:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788744539.736495:0:18642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17880:x1875634154562304:12345-0@lo:5:osp-pre-0-1.0 Request processed in 142us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744539.736504:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788744539.736666:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643fb1f80 x1875634154562304/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744555 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744539.736682:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875634154562304:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788744539.736704:0:17880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788744539.736766:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875634154562432:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788744539.736808:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744539.736833:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7455799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744539.737064:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562432 00000100:00100000:2.0:1788744539.737071:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562432 00000100:00100000:2.0:1788744539.737114:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744539.737123:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17880:x1875634154562432:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788744539.737189:0:18644:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1788744539.779986:0:18639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788744539.780012:0:18639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788744539.780342:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17880:x1875634154562432:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43215us (43528us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788744539.780352:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788744539.782644:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e91500 x1875634154562432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744555 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744539.782697:0:17880:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788744539.782706:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875634154562432:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788744539.782728:0:17880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788744539.782801:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17880:1875634154562560:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788744539.782881:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744539.782931:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7455799c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744539.783276:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562560 00000100:00100000:1.0:1788744539.783285:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562560 00000100:00100000:1.0:1788744539.783354:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744539.783367:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17880:x1875634154562560:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788744539.783482:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17880:x1875634154562560:12345-0@lo:900:osp-pre-0-1.0 Request processed in 116us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744539.783490:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744539.783619:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643e91500 x1875634154562560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788744555 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744539.783632:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17880:1875634154562560:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788744540.017940:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154562688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744540.018057:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744540.018110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154562816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744540.018136:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744540.019064:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562688 00000100:00100000:0.0:1788744540.019078:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562688 00000100:00100000:3.0:1788744540.019122:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562816 00000100:00100000:3.0:1788744540.019128:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562816 00000100:00100000:0.0:1788744540.019156:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744540.019231:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154562688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744540.019282:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788744540.019360:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154562688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744540.021336:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744540.021363:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154562816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744540.021421:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788744540.021458:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154562688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744540.021501:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154562816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744540.021511:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154562816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744540.021518:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744540.022236:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788744540.338338:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744541.361048:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744542.382562:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744543.406700:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744543.984298:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788744544.235808:0:19456:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788744544.235811:0:19456:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788744544.235813:0:19456:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788744544.235945:0:19456:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ac6431c3800 00000020:01000004:1.0:1788744544.235960:0:19456:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788744544.235986:0:19456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788744544.236001:0:19456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ac750754d40) 00000020:00000080:1.0:1788744544.236017:0:19456:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788744544.289111:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788744544.292501:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788744544.292701:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788744544.293000:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788744544.293394:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788744544.293717:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788744544.294002:0:19456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788744544.294848:0:19456:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788744544.295145:0:19456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788744544.295160:0:19456:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788744544.295172:0:19456:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb6207a6e76dcd55d 00000020:01000004:1.0:1788744544.295178:0:19456:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788744544.295199:0:19456:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788744544.295203:0:19456:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788744544.295217:0:19456:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788744544.295246:0:19456:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788744544.295250:0:19456:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788744544.304848:0:19456:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744544.304887:0:19456:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788744544.304891:0:19456:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744544.304893:0:19456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744544.304895:0:19456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744544.304963:0:19456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744544.304965:0:19456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744544.304967:0:19456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744544.304969:0:19456:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744544.304971:0:19456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744544.304972:0:19456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744544.304983:0:19456:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788744544.304986:0:19456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744544.304987:0:19456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744544.304988:0:19456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744544.304989:0:19456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744544.304990:0:19456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744544.304992:0:19456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744544.304993:0:19456:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744544.304994:0:19456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744544.304995:0:19456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744544.305024:0:19456:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744544.305044:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154562944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744544.305126:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.305223:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac77cc4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744544.305263:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154562944 00000100:00100000:0.0:1788744544.305272:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154562944 00000100:00100000:0.0:1788744544.305387:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788744544.305398:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:19456:x1875634154562944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744544.305467:0:17131:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788744544.305471:0:17131:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788744544.305475:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788744544.305997:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+21:19456:x1875634154562944:12345-0@lo:253:mount.lustre.0 Request processed in 599us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.306006:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788744544.306171:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154562944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744544.306183:0:19456:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788744544.306193:0:19456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744544.306195:0:19456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744544.306196:0:19456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744544.306198:0:19456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744544.306199:0:19456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744544.306200:0:19456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744544.306201:0:19456:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744544.306203:0:19456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744544.306204:0:19456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744544.306224:0:19456:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac6431c3800 from lustre-OST0001 10000000:01000000:2.0:1788744544.306251:0:19456:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788744544.306254:0:19456:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744544.306261:0:19456:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac643238000 local copy 00010000:00010000:2.0:1788744544.306270:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744544.306344:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744544.306373:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.306425:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643562840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744544.306535:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563072 00000100:00100000:1.0:1788744544.306540:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563072 00000100:00100000:1.0:1788744544.306574:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788744544.306582:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:19456:x1875634154563072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744544.306654:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:19456:x1875634154563072:12345-0@lo:501:mount.lustre.0 Request processed in 72us (279us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744544.306661:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788744544.306739:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563072:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788744544.306751:0:19456:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788744544.306772:0:19456:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788744544.306790:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.306800:0:19456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bee00/0xb6207a6e76dcd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd27e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744544.306833:0:19456:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac6431c3800 10000000:01000000:3.0:1788744544.306838:0:19456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744544.306842:0:19456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788744544.306845:0:19456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744544.306850:0:19456:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788744544.306852:0:19456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788744544.306875:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.306884:0:19456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.306892:0:19456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744544.307043:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744544.307073:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.307098:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.307144:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563200 00000100:00100000:2.0:1788744544.307148:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563200 00000100:00100000:2.0:1788744544.307168:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744544.307173:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:19456:x1875634154563200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744544.307182:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744544.307195:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcd56b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd564 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.307215:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcd56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd564 expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.307226:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b59c00/0xb6207a6e76dcd56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd564 expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.307246:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59c00, rc 0) 00000100:00100000:2.0:1788744544.307283:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563200:12345-0@lo:101:mount.lustre.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.307289:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788744544.307364:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744544.307376:0:19456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd56b expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.307384:0:19456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd56b expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744544.309199:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788744544.310097:0:19456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744544.312076:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788744544.312127:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788744544.312139:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788744544.312150:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788744544.312162:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788744544.312176:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788744544.312213:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788744544.312221:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788744544.312326:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744544.312389:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.312502:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.312630:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563328 00000100:00100000:2.0:1788744544.312636:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563328 00000100:00100000:2.0:1788744544.312702:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744544.312711:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744544.312849:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563328:12345-0@lo:501:mount.lustre.0 Request processed in 139us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.312857:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788744544.313055:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744544.313088:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744544.313126:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.313151:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744544.313199:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563456 00000100:00100000:0.0:1788744544.313204:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563456 00000100:00100000:0.0:1788744544.313234:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788744544.313240:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744544.313754:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563456:12345-0@lo:503:mount.lustre.0 Request processed in 513us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.313761:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788744544.313903:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788744544.314250:0:19456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744544.314314:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744544.314352:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.314371:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744544.314492:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563584 00000100:00100000:0.0:1788744544.314497:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563584 00000100:00100000:0.0:1788744544.314519:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788744544.314531:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744544.315055:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563584:12345-0@lo:502:mount.lustre.0 Request processed in 523us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.315064:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744544.315188:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744544.315365:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788744544.315394:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788744544.315438:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788744544.315455:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788744544.315473:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788744544.315488:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788744544.315503:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788744544.315529:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788744544.315547:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788744544.315573:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744544.315610:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.315636:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744544.315732:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563712 00000100:00100000:1.0:1788744544.315739:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563712 00000100:00100000:1.0:1788744544.315813:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788744544.315821:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744544.315930:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563712:12345-0@lo:502:mount.lustre.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744544.315937:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744544.316106:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744544.316148:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788744544.316157:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788744544.316848:0:19460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744544.316857:0:19460:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788744544.316864:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744544.316866:0:19460:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788744544.316872:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744544.316889:0:19460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ac776c28000) 00000020:00000080:2.0:1788744544.316923:0:19460:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788744544.316930:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788744544.317025:0:19460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac6431c3800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788744544.317035:0:19460:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788744544.317042:0:19460:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb6207a6e76dcd579 00010000:00010000:2.0:1788744544.320898:0:19460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788744544.321311:0:19460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788744544.323098:0:19460:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788744544.324360:0:19460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788744544.324373:0:19460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744544.324385:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744544.324387:0:19460:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788744544.324391:0:19460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744544.324396:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744544.324397:0:19460:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744544.324494:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744544.324496:0:19460:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788744544.324498:0:19460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744544.324501:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744544.324502:0:19460:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788744544.324505:0:19460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744544.324507:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744544.324509:0:19460:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788744544.324512:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788744544.324536:0:19460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744544.324540:0:19460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744544.324541:0:19460:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788744544.324544:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788744544.327273:0:19456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788744544.327325:0:19456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788744544.327349:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd56b expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.327363:0:19456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf400/0xb6207a6e76dcd564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd56b expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744544.327372:0:19456:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac6431c3800 from 1 10000000:01000000:3.0:1788744544.327376:0:19456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744544.327439:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.327448:0:19456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.327460:0:19456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744544.327484:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744544.327551:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.327603:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.327688:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563840 00000100:00100000:2.0:1788744544.327697:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563840 00000100:00100000:2.0:1788744544.327741:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744544.327751:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154563840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744544.327764:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744544.327788:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd580 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.327811:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.327823:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.327832:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58c00, rc 0) 00000100:00100000:2.0:1788744544.327875:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154563840:12345-0@lo:101:mount.lustre.0 Request processed in 125us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.327881:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788744544.328030:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744544.328044:0:19456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.328053:0:19456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744544.329031:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788744544.329290:0:19456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744544.329498:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788744544.329526:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788744544.329545:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788744544.329551:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788744544.329611:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744544.329659:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.329781:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.332548:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154563968 00000100:00100000:2.0:1788744544.332561:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154563968 00000100:00100000:2.0:1788744544.333080:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788744544.333093:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154563968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744544.333265:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154563968:12345-0@lo:501:mount.lustre.0 Request processed in 176us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.333273:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788744544.333350:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154563968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744544.333428:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744544.333476:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.335860:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7432f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744544.335955:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564096 00000100:00100000:3.0:1788744544.335965:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564096 00000100:00100000:3.0:1788744544.336015:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744544.336026:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744544.336177:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564096:12345-0@lo:503:mount.lustre.0 Request processed in 153us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.336185:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788744544.336355:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744544.336810:0:19456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744544.336892:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744544.336943:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.336982:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7432f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744544.337102:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564224 00000100:00100000:3.0:1788744544.337108:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564224 00000100:00100000:3.0:1788744544.337133:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744544.337141:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744544.337244:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564224:12345-0@lo:502:mount.lustre.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.337251:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788744544.337323:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744544.337619:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788744544.337648:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788744544.337663:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788744544.337695:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788744544.337712:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788744544.337726:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788744544.337740:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788744544.337753:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788744544.337764:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788744544.337791:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788744544.337809:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788744544.337834:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744544.337881:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.337911:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7432f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.338031:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564352 00000100:00100000:2.0:1788744544.338037:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564352 00000100:00100000:2.0:1788744544.338066:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744544.338075:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744544.338166:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564352:12345-0@lo:502:mount.lustre.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.338173:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788744544.338273:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744544.338311:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788744544.338318:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788744544.339097:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744544.339108:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339111:0:19464:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744544.339118:0:19464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac6431c3800 00000020:00000080:3.0:1788744544.339120:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744544.339128:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744544.339130:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339131:0:19464:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788744544.339134:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744544.339136:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339137:0:19464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744544.339141:0:19464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac6431c3800 00000020:00000080:3.0:1788744544.339142:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744544.339200:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744544.339203:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339205:0:19464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788744544.339207:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744544.339209:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339210:0:19464:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744544.339213:0:19464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac6431c3800 00000020:00000080:3.0:1788744544.339215:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744544.339232:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744544.339235:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339236:0:19464:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744544.339239:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744544.339241:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339242:0:19464:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788744544.339246:0:19464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac6431c3800 00000020:00000080:3.0:1788744544.339248:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744544.339283:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744544.339286:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744544.339288:0:19464:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788744544.339291:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788744544.339527:0:19456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788744544.339554:0:19456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744544.339576:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.339588:0:19456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744544.339637:0:19456:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744544.339640:0:19456:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac6431c3800 10000000:01000000:2.0:1788744544.339643:0:19456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac6431c3800 10000000:01000000:2.0:1788744544.339653:0:19456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744544.339659:0:19456:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ac6431c3800 from 1 10000000:01000000:2.0:1788744544.339662:0:19456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744544.339694:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.339703:0:19456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.339713:0:19456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744544.339732:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744544.339878:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.339906:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744544.339948:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564480 00000100:00100000:3.0:1788744544.339955:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564480 00000100:00100000:3.0:1788744544.340002:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744544.340011:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:19456:x1875634154564480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744544.340024:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744544.340036:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd58e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.340059:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd58e expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.340069:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac6437be800/0xb6207a6e76dcd595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd58e expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.340077:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac6437be800, rc 0) 00000100:00100000:3.0:1788744544.340115:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564480:12345-0@lo:101:mount.lustre.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.340121:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788744544.340206:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744544.340220:0:19456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd595 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744544.340228:0:19456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd595 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744544.343208:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788744544.343517:0:19456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744544.343704:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788744544.343728:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788744544.343742:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788744544.343755:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788744544.343766:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788744544.343793:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788744544.343816:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788744544.343828:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788744544.343840:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788744544.343855:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788744544.343868:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788744544.343880:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788744544.343893:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788744544.343921:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788744544.343936:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788744544.343950:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788744544.343964:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788744544.343990:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788744544.344007:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788744544.344023:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788744544.344036:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788744544.344050:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788744544.344063:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788744544.344079:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788744544.344094:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788744544.344110:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788744544.344124:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788744544.344138:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788744544.344150:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788744544.344179:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788744544.344195:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788744544.344209:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788744544.344223:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788744544.344238:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788744544.344251:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788744544.344264:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788744544.344276:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788744544.344289:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788744544.344301:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788744544.344331:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788744544.344345:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788744544.344358:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788744544.344370:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788744544.344384:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788744544.344396:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788744544.344448:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788744544.344471:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788744544.344477:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788744544.344557:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744544.344618:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.344648:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744544.344736:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564608 00000100:00100000:3.0:1788744544.344743:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564608 00000100:00100000:3.0:1788744544.344792:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788744544.344801:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744544.344916:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564608:12345-0@lo:501:mount.lustre.0 Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.344924:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788744544.346076:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744544.346125:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744544.346187:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.346222:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744544.347653:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564736 00000100:00100000:3.0:1788744544.347665:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564736 00000100:00100000:3.0:1788744544.347715:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788744544.347724:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744544.347857:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564736:12345-0@lo:503:mount.lustre.0 Request processed in 134us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.347865:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744544.348078:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744544.348498:0:19456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744544.348571:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744544.348620:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.348693:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744544.349092:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564864 00000100:00100000:3.0:1788744544.349098:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564864 00000100:00100000:3.0:1788744544.349136:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788744544.349144:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744544.349242:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564864:12345-0@lo:502:mount.lustre.0 Request processed in 98us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.349250:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744544.349330:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744544.349542:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788744544.349569:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788744544.349584:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788744544.349600:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788744544.349615:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788744544.349641:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788744544.349656:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788744544.349668:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788744544.349680:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788744544.349693:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788744544.349706:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788744544.349720:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788744544.349749:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788744544.349766:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788744544.349892:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788744544.349910:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788744544.349925:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788744544.349937:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788744544.349950:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788744544.349963:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788744544.349990:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788744544.350007:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788744544.350023:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788744544.350039:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788744544.350053:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788744544.350067:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788744544.350080:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788744544.350093:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788744544.350120:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788744544.350138:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788744544.350153:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788744544.350167:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788744544.350180:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788744544.350192:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788744544.350205:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788744544.350218:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788744544.350232:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788744544.350245:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788744544.350271:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788744544.350286:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788744544.350300:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788744544.350313:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788744544.350328:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788744544.350339:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788744544.350365:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788744544.350381:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788744544.350396:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788744544.351263:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788744544.351324:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744544.351398:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.355969:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.356608:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154564992 00000100:00100000:2.0:1788744544.356620:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154564992 00000100:00100000:2.0:1788744544.356677:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744544.356686:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744544.356849:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154564992:12345-0@lo:502:mount.lustre.0 Request processed in 163us (5450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.356857:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744544.356925:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154564992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744544.357143:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788744544.357171:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788744544.357206:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154565120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744544.357254:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744544.357282:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565120 00000100:00100000:2.0:1788744544.357286:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565120 00000100:00100000:2.0:1788744544.357311:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744544.357326:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154565120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744544.357388:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154565120:12345-0@lo:502:mount.lustre.0 Request processed in 62us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744544.357395:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744544.357511:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6436d9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744544.357525:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154565120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744544.357561:0:19456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788744544.357569:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788744544.373079:0:19467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788744544.373098:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ac6433c0000) 00000020:00000080:0.0:1788744544.373123:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788744544.373218:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac6431c3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788744544.373223:0:19467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac6431c3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788744544.373226:0:19467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac6431c3800 3 00010000:00080000:0.0:1788744544.373254:0:19467:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac77c947000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788744544.374909:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788744544.378735:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788744544.378802:0:19467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744544.378816:0:19467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb6207a6e76dcd5a3 00000100:00080000:0.0:1788744544.378828:0:19467:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744544.378840:0:19467:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac77c947000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744544.378881:0:19467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac6435f2680 x1875634154565248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744544.378923:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154565248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744544.378997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744544.379053:0:19467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788744544.379095:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744544.379100:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744544.379102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744544.379112:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744544.379161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744544.379164:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788744544.379166:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744544.379171:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1788744544.379175:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788744544.379181:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ac751dc6000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788744544.379193:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643f29180 x1875634154565888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744544.379234:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154565504:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379265:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379283:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154566144:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379306:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379324:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788744544.379330:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154565376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379354:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379372:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154566016:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379438:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154565632:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154566272:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379524:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744544.379529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154565760:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379558:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744544.379589:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565376 00000100:00100000:0.0:1788744544.379596:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565376 00000100:00100000:0.0:1788744544.379633:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565632 00000100:00100000:0.0:1788744544.379635:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565632 00000100:00100000:0.0:1788744544.379650:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744544.379658:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154565376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379705:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154565376:12345-0@lo:400:kworker.0 Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.379712:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744544.379725:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744544.379731:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154565632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379760:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154565632:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.379766:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744544.379782:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565248 00000100:00100000:0.0:1788744544.379786:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565248 00000100:00100000:0.0:1788744544.379797:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565504 00000100:00100000:0.0:1788744544.379799:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565504 00000100:00100000:0.0:1788744544.379810:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566144 00000100:00100000:0.0:1788744544.379812:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566144 00000100:00100000:0.0:1788744544.379848:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566016 00000100:00100000:0.0:1788744544.379852:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566016 00000100:00100000:0.0:1788744544.379861:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566272 00000100:00100000:0.0:1788744544.379863:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566272 00000100:00100000:0.0:1788744544.379875:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744544.379880:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154565504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379910:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875634154565504:12345-0@lo:400:kworker.0 Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.379925:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744544.379938:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744544.379944:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154566144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.379968:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875634154566144:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.379986:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744544.379997:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744544.380003:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154566016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.380027:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154566016:12345-0@lo:400:kworker.0 Request processed in 24us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.380032:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744544.380043:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744544.380048:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154566272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.380072:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154566272:12345-0@lo:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.380078:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744544.380089:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744544.380093:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154565248:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788744544.380113:0:17139:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788744544.380141:0:17139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb6207a6e76dcd5aa 00000004:00100000:0.0:1788744544.380154:0:17139:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744544.380181:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9ac643ece000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744544.380212:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875634154565248:12345-0@lo:38:llog_process_th.0 Request processed in 117us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.380227:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788744544.380253:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744544.380257:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744544.380270:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154565888:0@lo:8:kworker.0 00000100:00100000:0.0:1788744544.380299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788744544.380334:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6435f2680 x1875634154565248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.380344:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744544.380351:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788744544.380358:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744544.380362:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744544.380364:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac77c947000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744544.380369:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875634154565248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744544.380425:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565760 00000100:00100000:0.0:1788744544.380430:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565760 00000100:00100000:0.0:1788744544.380464:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154565888 00000100:00100000:0.0:1788744544.380467:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154565888 00000100:00100000:0.0:1788744544.380481:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744544.380487:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154565760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.380517:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154565760:12345-0@lo:400:kworker.0 Request processed in 31us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.380523:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744544.380534:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744544.380538:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875634154565888:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788744544.380584:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875634154565888:12345-0@lo:8:kworker.0 Request processed in 45us (285us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788744544.380595:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788744544.380609:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744544.380625:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643f28700 x1875634154565760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.380635:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154565760:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.380645:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154565632:0@lo:400:kworker.0 00010000:00080000:0.0:1788744544.380654:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643f2a680 x1875634154566272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.380662:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154566272:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.380689:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154565376:0@lo:400:kworker.0 00010000:00080000:0.0:1788744544.380699:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643f2b480 x1875634154566016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.380707:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154566016:0@lo:400:kworker.0 00010000:00080000:0.0:1788744544.380717:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac6435f0000 x1875634154565504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.380725:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875634154565504:0@lo:400:kworker.0 00010000:00080000:0.0:1788744544.380735:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643f28000 x1875634154566144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.380742:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875634154566144:0@lo:400:kworker.0 00000100:00100000:0.0:1788744544.380765:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744544.380769:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744544.380778:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788744544.380781:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154565888:0@lo:8:kworker.0 00000020:01000004:1.0:1788744544.388338:0:19467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788744544.388356:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ac7507519c0) 00000020:00000080:1.0:1788744544.388382:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788744544.388499:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac6431c3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788744544.388503:0:19467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac6431c3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788744544.388506:0:19467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac6431c3800 3 00010000:00080000:1.0:1788744544.388535:0:19467:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ac642608800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788744544.391550:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788744544.393709:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788744544.393756:0:19467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744544.393769:0:19467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb6207a6e76dcd5b8 00000100:00080000:1.0:1788744544.394482:0:19467:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744544.394495:0:19467:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ac642608800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788744544.394528:0:19467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac643fb0700 x1875634154566400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744544.394554:0:19467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788744544.394635:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875634154566400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744544.394708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744544.395017:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566400 00000100:00100000:1.0:1788744544.395024:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566400 00000100:00100000:1.0:1788744544.395057:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744544.395063:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875634154566400:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788744544.395090:0:17139:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1788744544.395123:0:17139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb6207a6e76dcd5bf 00000004:00100000:1.0:1788744544.395137:0:17139:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744544.395166:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9ac64260d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744544.395221:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875634154566400:12345-0@lo:38:llog_process_th.0 Request processed in 156us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744544.395228:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788744544.395267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744544.395272:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744544.395275:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744544.395278:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788744544.395314:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac643fb0700 x1875634154566400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744544.395323:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744544.395330:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788744544.395336:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744544.395340:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788744544.395342:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac642608800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744544.395348:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875634154566400:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788744544.405991:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788744544.407960:0:19456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788744544.410559:0:19456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744544.410584:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd595 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.410598:0:19456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b58800/0xb6207a6e76dcd58e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd595 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788744544.410649:0:19456:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788744544.410651:0:19456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744544.410653:0:19456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744544.410654:0:19456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744544.410659:0:19456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744544.410661:0:19456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744544.410662:0:19456:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744544.410664:0:19456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744544.410665:0:19456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788744544.410670:0:19456:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788744544.410672:0:19456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744544.410673:0:19456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744544.410674:0:19456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744544.410675:0:19456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744544.410676:0:19456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744544.410677:0:19456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744544.410678:0:19456:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744544.410679:0:19456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744544.410680:0:19456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788744544.410709:0:19456:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788744544.410729:0:19456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154566528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788744544.410876:0:19456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744544.410917:0:19456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7602983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744544.411485:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566528 00000100:00100000:1.0:1788744544.411494:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566528 00000100:00100000:1.0:1788744544.411539:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788744544.411546:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:19456:x1875634154566528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744544.411573:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788744544.411590:0:17132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788744544.416107:0:17132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788744544.416124:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788744544.416255:0:17153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788744544.416260:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788744544.416282:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416300:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 24 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416309:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416326:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416362:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416376:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 24 pid: 17132 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744544.416391:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154566656:0@lo:104: 00000100:00100000:1.0:1788744544.416620:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744544.416673:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 24 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416682:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 24 pid: 17130 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744544.416692:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154566784:0@lo:104: 00000100:00100000:1.0:1788744544.416713:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744544.416743:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75128a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744544.416766:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566656 00000100:00100000:1.0:1788744544.416826:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566656 00000100:00100000:1.0:1788744544.416864:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566784 00000100:00100000:1.0:1788744544.416868:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566784 00000100:00100000:1.0:1788744544.416884:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744544.416892:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154566656:12345-0@lo:104: 00010000:00010000:1.0:1788744544.416905:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.416982:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744544.416988:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154566656:12345-0@lo:104: Request processed in 97us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744544.416996:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744544.417207:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744544.417218:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154566784:12345-0@lo:104: 00010000:00010000:3.0:1788744544.417227:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417268:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744544.417274:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3734829d-853b-494e-83d0-e0bd2808e668+4:17153:x1875634154566784:12345-0@lo:104: Request processed in 59us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.417280:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788744544.417389:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744544.417396:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417419:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bec00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744544.417430:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417439:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744544.417446:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744544.417453:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744544.417481:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417488:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744544.417509:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417516:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bec00/0xb6207a6e76dcd541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417530:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744544.417534:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417540:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:3.0:1788744544.417543:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417550:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744544.417568:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744544.417574:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744544.417588:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417594:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744544.417609:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417616:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741534a00/0xb6207a6e76dcd533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd53a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.417629:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744544.417631:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744544.417632:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744544.417817:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154566912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744544.417857:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.417890:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154567040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744544.417911:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744544.417942:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154566912 00000100:00100000:3.0:1788744544.417947:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154566912 00010000:00010000:3.0:1788744544.417967:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 25 pid: 17132 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744544.417998:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567040 00000100:00100000:3.0:1788744544.418001:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567040 00010000:00010000:3.0:1788744544.418021:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 26 pid: 17130 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744544.418034:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744544.418041:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+26:3644:x1875634154566912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744544.418051:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744544.418056:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 26 pid: 17132 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418066:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 26 pid: 17132 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418079:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744544.418108:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+26:3644:x1875634154566912:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.418114:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744544.418127:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744544.418133:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+25:3645:x1875634154567040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744544.418140:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744544.418144:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 25 pid: 17130 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418153:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 25 pid: 17130 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418165:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418173:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744544.418197:0:17124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004621316s 00010000:00010000:3.0:1788744544.418202:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418209:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418215:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418222:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418227:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744544.418231:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418239:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418247:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744544.418256:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744544.418283:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3734829d-853b-494e-83d0-e0bd2808e668+25:3645:x1875634154567040:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744544.418290:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744544.418328:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154566912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744544.418353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154567040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744544.418618:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dac200/0xb6207a6e76dcd548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd541 expref: 24 pid: 17132 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744544.418632:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154566656:0@lo:104: 00010000:00010000:1.0:1788744544.418642:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd53a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd533 expref: 23 pid: 17130 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744544.418650:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875634154566784:0@lo:104: 00010000:00010000:1.0:1788744544.418663:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.418672:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.418679:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744544.418685:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741534600/0xb6207a6e76dcd5c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744544.419227:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+22:19456:x1875634154566528:12345-0@lo:253:mount.lustre.0 Request processed in 7678us (8347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744544.419237:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:3.0:1788744544.419385:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744544.419492:0:19456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3734829d-853b-494e-83d0-e0bd2808e668:19456:1875634154566528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788744544.419504:0:19456:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788744544.419507:0:19456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744544.419517:0:19456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744544.419519:0:19456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744544.419520:0:19456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744544.419521:0:19456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744544.419522:0:19456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744544.419524:0:19456:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744544.419525:0:19456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744544.419527:0:19456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788744544.419538:0:19456:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788744544.431486:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788744544.431686:0:19456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788744544.434035:0:19456:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788744544.434044:0:19456:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788744544.434079:0:19456:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744544.434117:0:19456:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744544.434138:0:19456:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788744544.434156:0:19456:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788744544.435093:0:19456:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744544.435335:0:19456:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788744545.135544:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154567168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744545.135613:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.135796:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744545.135807:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154567296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744545.135839:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744545.136074:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567168 00000100:00100000:0.0:1788744545.136083:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567168 00000100:00100000:0.0:1788744545.136139:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744545.136147:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154567168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744545.136176:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788744545.136222:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154567168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744545.136230:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744545.136252:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567296 00000100:00100000:0.0:1788744545.136257:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567296 00000100:00100000:0.0:1788744545.136282:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744545.136288:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154567296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744545.136312:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788744545.136343:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154567296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744545.136349:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788744545.136389:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643fb1500 x1875634154567168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744545.136430:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154567168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744545.136498:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154567424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744545.136528:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.136563:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154567296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744545.136710:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567424 00000100:00100000:0.0:1788744545.136715:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567424 00000100:00100000:0.0:1788744545.136762:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744545.136771:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154567424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744545.136790:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744545.136877:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154567424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744545.136884:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744545.146225:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154567424:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788744545.295720:0:19523:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744545.296002:0:19523:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788744545.454508:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744525/real 1788744525] req@ffff9ac643e44a80 x1875634154554624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788744545.454527:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744545.454566:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e44a80 x1875634154554624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744545.454576:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744525/real 1788744525] req@ffff9ac643e44000 x1875634154554752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744545.454587:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac643e44000 x1875634154554752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744545.454607:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744545.454623:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744545.454627:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154554624:0@lo:8:kworker.0 00000100:00080000:0.0:1788744545.454633:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744545.454637:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744545.454640:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154554752:0@lo:8:kworker.0 00000100:00080000:2.0:1788744545.454996:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744545.455001:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788744545.455003:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744545.455009:0:475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1788744545.455014:0:475:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788744545.455024:0:475:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac643703800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744545.455041:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac745071c00 x1875634154567808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744545.455054:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744545.455063:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788744545.455065:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744545.455069:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1788744545.455071:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788744545.455076:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac748bff000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744545.455087:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac745070000 x1875634154567936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744545.455135:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744545.455138:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788744545.455139:0:475:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744545.455145:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ac751dc6000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788744545.455155:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac745072d80 x1875634154568448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744545.455214:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154567808:0@lo:8:kworker.0 00000100:00100000:3.0:1788744545.455230:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154567680:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.456393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154567552:0@lo:400:kworker.0 00000100:00100000:3.0:1788744545.456434:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.456451:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.456811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154568320:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.456842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.456864:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154568960:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.456928:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.456976:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154568064:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.457020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154568704:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457040:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.457056:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744545.457062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154568192:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457081:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.457098:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154568832:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.457159:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567552 00000100:00100000:1.0:1788744545.457167:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567552 00000100:00100000:1.0:1788744545.457217:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788744545.457225:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:3645:x1875634154567552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457273:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:3645:x1875634154567552:12345-0@lo:400:kworker.0 Request processed in 48us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457279:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788744545.457313:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568320 00000100:00100000:1.0:1788744545.457317:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568320 00000100:00100000:1.0:1788744545.457346:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744545.457353:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154568320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457385:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154568320:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457392:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744545.457581:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568960 00000100:00100000:1.0:1788744545.457585:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568960 00000100:00100000:1.0:1788744545.457614:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568064 00000100:00100000:1.0:1788744545.457617:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568064 00000100:00100000:1.0:1788744545.457627:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568704 00000100:00100000:1.0:1788744545.457628:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568704 00000100:00100000:1.0:1788744545.457637:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568832 00000100:00100000:1.0:1788744545.457638:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568832 00000100:00100000:1.0:1788744545.457649:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744545.457654:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154568960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457687:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154568960:12345-0@lo:400:kworker.0 Request processed in 33us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457693:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744545.457703:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744545.457708:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154568064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457735:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154568064:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457747:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744545.457758:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744545.457765:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457791:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154568704:12345-0@lo:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457797:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744545.457808:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744545.457813:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154568832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457838:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875634154568832:12345-0@lo:400:kworker.0 Request processed in 25us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457844:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744545.457868:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567680 00000100:00100000:1.0:1788744545.457873:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567680 00000100:00100000:1.0:1788744545.457894:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568192 00000100:00100000:1.0:1788744545.457897:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568192 00000100:00100000:1.0:1788744545.457908:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744545.457914:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154567680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.457947:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154567680:12345-0@lo:400:kworker.0 Request processed in 33us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.457953:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744545.457964:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744545.458208:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154568192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.458239:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154568192:12345-0@lo:400:kworker.0 Request processed in 35us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.458244:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744545.458296:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154567552:0@lo:400:kworker.0 00010000:00080000:1.0:1788744545.458310:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745072680 x1875634154568320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744545.458321:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154568320:0@lo:400:kworker.0 00010000:00080000:1.0:1788744545.458331:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643355880 x1875634154568960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744545.458340:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154568960:0@lo:400:kworker.0 00000100:00100000:3.0:1788744545.460833:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154567680:0@lo:400:kworker.0 00000100:00100000:3.0:1788744545.460848:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154568576:0@lo:400:kworker.0 00000100:00100000:3.0:1788744545.460903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.460938:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154569088:0@lo:400:kworker.0 00000100:00100000:3.0:1788744545.460963:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744545.462303:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744545.462348:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154567936:0@lo:8:kworker.0 00000100:00100000:2.0:1788744545.462391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744545.462421:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154568448:0@lo:8:kworker.0 00000100:00100000:2.0:1788744545.462440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744545.462481:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567808 00000100:00100000:2.0:1788744545.462488:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567808 00000100:00100000:2.0:1788744545.462517:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154567936 00000100:00100000:2.0:1788744545.462520:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154567936 00000100:00100000:2.0:1788744545.462528:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568448 00000100:00100000:2.0:1788744545.462530:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568448 00000100:00100000:3.0:1788744545.462939:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744545.462949:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875634154567808:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788744545.462995:0:19228:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1788744545.463024:0:19228:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd5cd 00002000:00100000:3.0:1788744545.463036:0:19228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ac775e84000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788744545.463041:0:19228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788744545.463052:0:19228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788744545.463259:0:19228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744545.463286:0:19228:0:(import.c:65:import_set_state_nolock()) ffff9ac775e87800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744545.463347:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875634154567808:12345-0@lo:8:kworker.0 Request processed in 397us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744545.463355:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744545.463376:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744545.463380:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875634154567936:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788744545.463395:0:19228:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1788744545.463438:0:19228:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb6207a6e76dcd5d4 00002000:00100000:3.0:1788744545.463444:0:19228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ac775e86000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788744545.463447:0:19228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788744545.463450:0:19228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788744545.463654:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744545.463667:0:18642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875634154568448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788744545.463682:0:18642:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:2.0:1788744545.463696:0:18642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb6207a6e76dcd5db 00002000:00100000:2.0:1788744545.463702:0:18642:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ac6422f4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788744545.463706:0:18642:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788744545.463707:0:18642:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788744545.463734:0:18642:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788744545.463746:0:18642:0:(import.c:65:import_set_state_nolock()) ffff9ac6422f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744545.463780:0:18642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875634154568448:12345-0@lo:8:kworker.0 Request processed in 113us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744545.463787:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788744545.466051:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744545.466245:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154568192:0@lo:400:kworker.0 00010000:00080000:1.0:1788744545.466268:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745072300 x1875634154568832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744545.466280:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875634154568832:0@lo:400:kworker.0 00010000:00080000:1.0:1788744545.466292:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745070700 x1875634154568064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744545.466300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154568064:0@lo:400:kworker.0 00010000:00080000:1.0:1788744545.466311:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745073b80 x1875634154568704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744545.466318:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154568704:0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.466371:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154568576 00000100:00100000:1.0:1788744545.466377:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154568576 00000100:00100000:1.0:1788744545.466445:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569088 00000100:00100000:1.0:1788744545.466449:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569088 00000100:00100000:1.0:1788744545.466478:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744545.466496:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154568576:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1788744545.467385:0:19228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788744545.467436:0:19228:0:(import.c:65:import_set_state_nolock()) ffff9ac775e81000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744545.474950:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875634154567936:12345-0@lo:8:kworker.0 Request processed in 11545us (12535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744545.474974:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788744545.475051:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745071c00 x1875634154567808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.475064:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744545.475075:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788744545.475084:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788744545.475089:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788744545.475092:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac643703800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788744545.475314:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788744545.475337:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154567808:0@lo:8:kworker.0 00010000:00080000:3.0:1788744545.475355:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745070000 x1875634154567936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.475363:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744545.475368:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788744545.475372:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788744545.475376:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788744545.475378:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac748bff000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788744545.475392:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788744545.475396:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875634154567936:0@lo:8:kworker.0 00010000:00080000:3.0:1788744545.475510:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745072d80 x1875634154568448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744545.475521:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788744545.475526:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788744545.475692:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788744545.475696:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ac751dc6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788744545.475710:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788744545.475714:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875634154568448:0@lo:8:kworker.0 00000004:00080000:3.0:1788744545.475785:0:17164:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788744545.475806:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875634154569344:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788744545.475852:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.475876:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742c6f600 going to sleep for 11 seconds 00000004:00080000:3.0:1788744545.475901:0:17163:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788744545.476065:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875634154568576:12345-0@lo:400:kworker.0 Request processed in 9568us (15159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.476076:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788744545.476105:0:17161:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788744545.476303:0:17161:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 527157900590ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788744545.476310:0:17161:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788744545.476390:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744545.476416:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154569088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744545.476465:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875634154569088:12345-0@lo:400:kworker.0 Request processed in 67us (15501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.476471:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744545.476492:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569344 00000100:00100000:1.0:1788744545.476497:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569344 00000100:00100000:1.0:1788744545.476722:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744545.476730:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17164:x1875634154569344:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788744545.476929:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788744545.477286:0:17163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 527158883306ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788744545.477293:0:17163:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788744545.477306:0:17881:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788744545.477358:0:17881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 527158955258ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788744545.477363:0:17881:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788744545.477391:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154569216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744545.477446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788744545.477929:0:17162:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788744545.478028:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875634154569600:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788744545.478068:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744545.478086:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75e2ae0c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788744545.478337:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788744545.478371:0:17882:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788744545.478385:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875634154569856:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788744545.478428:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.478442:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac751a81900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744545.479771:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569216 00000100:00100000:3.0:1788744545.479784:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569216 00000100:00100000:3.0:1788744545.479837:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744545.479846:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875634154569216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744545.479869:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788744545.480068:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569600 00000100:00100000:1.0:1788744545.480073:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569600 00000100:00100000:1.0:1788744545.480103:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569856 00000100:00100000:1.0:1788744545.480106:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569856 00000100:00100000:1.0:1788744545.480740:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744545.480751:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17162:x1875634154569600:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744545.481766:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875634154569216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1916us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744545.481777:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744545.481821:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154569472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744545.481878:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788744545.483055:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b78000 x1875634154569216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.483081:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154569216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744545.483696:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569472 00000100:00100000:3.0:1788744545.483705:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569472 00000100:00100000:3.0:1788744545.483742:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744545.483749:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875634154569472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744545.484088:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788744545.484253:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875634154569472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 502us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744545.484261:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744545.484287:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f2b480 x1875634154569472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744545.484305:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154569472:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788744545.486237:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac745071f80 x1875634154568576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.486266:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875634154568576:0@lo:400:kworker.0 00010000:00080000:3.0:1788744545.486283:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643357100 x1875634154569088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.486291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875634154569088:0@lo:400:kworker.0 00000100:00100000:3.0:1788744545.486314:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744545.486324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154569728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744545.486375:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.486420:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569728 00000100:00100000:3.0:1788744545.486425:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569728 00000100:00100000:3.0:1788744545.486460:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744545.486467:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875634154569728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788744545.486489:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788744545.486526:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875634154569728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744545.486532:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788744545.486877:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744545.486882:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788744545.487722:0:18644:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788744545.487809:0:18644:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788744545.487815:0:18644:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:0.0:1788744545.507617:0:18645:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788744545.507634:0:18645:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788744545.507642:0:18645:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:3.0:1788744545.515699:0:17870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788744545.518807:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.518818:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.518836:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.518840:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.518846:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.518864:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.518874:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.518881:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.518899:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.519087:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.519094:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.519383:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.519389:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.519399:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.519434:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.519442:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd5e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.519461:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.519463:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.519465:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788744545.519673:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643fb1880 x1875634154569728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.519698:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154569728:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788744545.534334:0:17117:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788744545.534358:0:17117:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788744545.539259:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.539274:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.539292:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.539296:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.539302:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.539331:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.539347:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.539356:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.539380:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744545.542005:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.542022:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.542039:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.542044:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.542051:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.542065:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.542076:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.542096:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.542882:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788744545.545047:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.545060:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.545076:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.545080:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.545086:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.545099:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.545110:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547242:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547258:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788744545.547482:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744545.547490:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547507:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.547512:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547522:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547543:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547550:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd5e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547570:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744545.547574:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547581:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.547584:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547591:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547601:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547614:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd5f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547629:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.547632:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547638:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.547641:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547648:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547658:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547666:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcd5f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.547678:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.547680:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.547681:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.547689:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.555568:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.555580:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.555597:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.555601:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.555607:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.555622:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.555632:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.555640:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.555662:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788744545.556300:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.556309:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556319:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.556322:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.556327:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556350:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556359:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556366:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556382:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788744545.556737:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.556743:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556751:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.556754:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.556759:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556829:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556840:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556859:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.556869:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788744545.557159:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744545.557167:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557184:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.557188:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557197:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557217:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557223:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2468b58/0xb6207a6e76dcd5fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557243:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744545.557247:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557253:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.557256:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557263:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557274:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557287:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096fc19d7/0xb6207a6e76dcd605 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557301:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.557305:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557312:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.557314:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557322:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557332:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557338:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd60c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557351:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.557354:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.557357:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.557602:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.557608:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.557618:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.557621:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.557625:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.557635:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.557643:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.557650:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.557668:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.557956:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.557962:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.557991:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.557994:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.558002:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.558014:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.558021:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.558039:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.558040:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.558042:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.558624:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.559647:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.559660:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.559684:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.559688:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.559694:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.559709:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.559719:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.559727:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.559748:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.559883:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.559889:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.559897:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.559901:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.559910:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.559932:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.559940:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd61a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.559957:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.559959:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.559961:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.561706:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.561721:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.561738:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.561742:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.561748:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.561762:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562332:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562341:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562366:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.562381:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.562387:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562395:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.562416:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562426:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562443:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562451:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3733593/0xb6207a6e76dcd621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.562469:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.562477:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.562479:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.565340:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.565353:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.565370:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.565374:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.565380:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.565393:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.565434:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.565442:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.565459:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.565471:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.565476:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.565484:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.565487:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.567383:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.567430:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.567440:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b682b35/0xb6207a6e76dcd628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.567462:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.567465:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.567468:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.569049:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.569060:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.569077:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.569082:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.569088:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.569102:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744545.569342:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.569350:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.569359:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.569363:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.569367:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.569381:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.569389:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.569398:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.569454:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.569961:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.569992:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570006:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.570012:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570020:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.570024:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570033:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570053:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570061:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80962bc/0xb6207a6e76dcd636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570077:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.570079:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.570081:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.570521:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.570533:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.570544:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570552:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.570556:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570564:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570576:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570583:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a2f5424/0xb6207a6e76dcd62f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.570598:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.570600:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.570602:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.571476:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.571486:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.571511:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.571515:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.571520:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.571531:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.571540:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.571548:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.571569:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788744545.571911:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.571918:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.571927:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.571930:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.571933:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.571955:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.571963:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.571984:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.571996:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788744545.572476:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.572484:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.572505:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.572509:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.572513:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.572523:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.572531:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.572550:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.572559:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788744545.572933:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744545.572941:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.572950:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.572959:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.572983:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573001:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573009:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f2207aa/0xb6207a6e76dcd63d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573027:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744545.573032:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573039:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.573042:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573050:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573059:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573067:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3733593/0xb6207a6e76dcd644 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573087:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.573090:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573097:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.573100:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573107:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573305:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573314:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000385089ee/0xb6207a6e76dcd64b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.573328:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.573330:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.573332:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.573471:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.573478:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573486:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.573489:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.573505:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573515:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573523:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573530:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573547:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.573556:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.573559:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573573:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.573576:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573584:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573595:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573602:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.573616:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.573618:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.573620:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.574063:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.574230:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.574237:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574247:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.574250:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.574255:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574265:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574280:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574287:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574301:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.574309:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.574314:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574321:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.574324:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574332:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574346:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574354:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574369:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.574378:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.574380:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.574918:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.574925:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574934:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.574937:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.574942:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574951:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574959:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574980:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.574997:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.575004:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.575008:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575014:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.575018:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575037:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575047:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575054:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575067:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.575069:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.575070:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.575248:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.575255:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575264:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.575273:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.575277:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575286:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575294:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575300:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575317:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.575675:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.575681:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575691:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.575694:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575703:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575716:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575735:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cd7cfe/0xb6207a6e76dcd667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.575752:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.575754:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.575755:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.575928:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.575935:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575943:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.575946:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.575950:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575960:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575977:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.575991:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.576010:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.576440:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.576447:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.576454:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170e00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.576458:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.576465:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.576478:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.576485:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734f8ea0/0xb6207a6e76dcd66e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744545.576790:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788744545.576790:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.576801:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.576804:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.576820:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.576825:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.576832:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.576842:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.576848:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.576849:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.576859:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.576862:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.576881:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.576886:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.576899:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.576901:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744545.576912:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.576923:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788744545.577382:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.577389:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.577398:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.577424:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.577428:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.577439:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.577460:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.577467:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.577475:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788744545.577588:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788744545.577593:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577608:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.577612:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577621:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577635:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577642:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f74f42a4/0xb6207a6e76dcd67c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577655:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744545.577659:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577665:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.577667:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577675:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577684:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577697:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd675 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577713:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.577717:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577724:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.577728:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577736:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577747:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577754:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.577778:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.577781:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.577783:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.577790:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.581242:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.581268:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.581286:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.581291:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.581298:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.581314:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.581325:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.581333:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.581356:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744545.582109:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744545.582127:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.582138:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dada00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744545.582143:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.582152:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.582173:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.582181:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b127908/0xb6207a6e76dcd68a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.582205:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.582215:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.582217:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.582368:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.582376:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.582391:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.582394:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.582430:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.582442:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.582450:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.582457:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.582477:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744545.583045:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744545.583053:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.583063:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782171800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744545.583067:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.583075:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.583089:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.583096:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007428527c/0xb6207a6e76dcd691 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.583128:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.583130:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.583132:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.583348:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.583356:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.583364:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.583367:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.583371:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.583381:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.583429:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.583438:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.583453:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744545.584075:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744545.584083:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.584092:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744545.584096:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.584112:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.584136:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.584143:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd83c1a8/0xb6207a6e76dcd698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.584158:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.584160:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.584162:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.584339:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.584346:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584355:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.584358:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.584362:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584373:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584381:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584389:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584447:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.584458:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.584462:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584469:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741534600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.584472:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584480:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584584:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584593:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d998c67/0xb6207a6e76dcd69f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.584610:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.584611:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.584613:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.585765:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.585788:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.585802:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.585813:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.585819:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.585833:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.585843:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.585850:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.585878:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.586058:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.586067:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.586075:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.586079:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.586087:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.586110:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.586127:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094df988b/0xb6207a6e76dcd6a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.586143:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.586145:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.586147:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.586356:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.586364:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.586373:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.586377:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.586381:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.586391:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.586428:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.586444:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.586461:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.586718:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.586724:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.586732:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.586735:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.586743:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.586756:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.586776:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.586793:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.586795:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.586797:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.587551:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.587559:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.587570:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.587574:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.587578:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.587588:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.587596:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.587604:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744545.592343:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.592358:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.592376:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.592380:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.592386:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.592413:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.592425:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.592432:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.592537:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744545.592870:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788744545.592907:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744545.592915:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.592924:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.592929:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.592938:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.592955:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.592963:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deb20741/0xb6207a6e76dcd6b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.592992:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.592996:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.593009:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.593013:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.593020:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.593032:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.593039:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179ccfd9/0xb6207a6e76dcd6bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.593054:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.593056:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.593058:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.594699:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788744545.594702:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.594714:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.594714:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.594737:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.594739:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788744545.594745:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.594746:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.594758:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.594758:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.594777:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.594796:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.594798:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.594814:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.594817:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.594835:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.594847:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744545.594852:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788744545.595020:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744545.595026:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595035:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744545.595038:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595047:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595064:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595072:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b9b8b5/0xb6207a6e76dcd6c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595092:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744545.595095:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595101:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:2.0:1788744545.595105:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595126:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595138:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595145:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd6c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.595157:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744545.595159:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744545.595160:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.595302:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.595677:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.595685:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.595694:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.595698:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.595701:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.595711:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.595731:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.595738:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.595756:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744545.596101:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.596108:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596191:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.596194:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.596198:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596208:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596215:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596222:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596247:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788744545.596609:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.596615:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596624:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.596628:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.596632:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596641:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596648:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596656:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.596665:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788744545.597009:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744545.597018:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597027:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.597031:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597040:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597065:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597072:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384b3ded/0xb6207a6e76dcd6d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597091:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744545.597095:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597101:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.597104:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.597112:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744545.597239:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.597245:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.597253:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.597262:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.597267:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.597277:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.597285:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.597293:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.597302:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744545.597629:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1788744545.597761:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.598387:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598396:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c7711a/0xb6207a6e76dcd6d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598431:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.598435:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598451:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.598455:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598464:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598475:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598483:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcd6e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.598496:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.598498:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.598500:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.598704:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.598712:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.598722:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.598726:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.598732:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.598743:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.598751:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.598851:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.598862:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.598865:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.598869:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.598880:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.598889:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.598897:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.598923:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.599333:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.599339:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599347:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.599351:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599359:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599381:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599388:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9ab8378/0xb6207a6e76dcd6ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599446:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.599449:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.599451:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.599614:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.599634:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.599952:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.599957:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599975:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.599979:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.599988:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.600000:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.600007:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d55c0698/0xb6207a6e76dcd6f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.600033:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.600035:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.600037:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.603177:0:18644:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.603193:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.603211:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.603216:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.603221:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.603234:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.603244:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.603251:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.603276:0:18644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788744545.603362:0:18644:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788744545.603475:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17162:x1875634154569600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 122722us (125402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744545.603674:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875634154569600:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788744545.603692:0:17162:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788744545.603739:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875634154569984:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788744545.603820:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744545.603844:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6431e5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744545.603865:0:18642:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788744545.603874:0:18642:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:1.0:1788744545.604267:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.604276:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604287:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.604291:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604300:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604319:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604326:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd6fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604348:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.604350:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.604352:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.604446:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.604454:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604475:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.604480:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.604484:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744545.604625:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744545.604656:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154569984 00000100:00100000:3.0:1788744545.604664:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154569984 00000100:00100000:3.0:1788744545.604707:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744545.604717:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17882:x1875634154569856:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:1.0:1788744545.604899:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604911:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604919:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604937:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.604947:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.604951:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604958:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.604961:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.604983:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.605008:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.605017:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba834d12/0xb6207a6e76dcd701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.605033:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.605035:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.605037:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.605669:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.605681:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.605691:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.605695:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.605702:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.605715:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.605722:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd6de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.605740:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.605742:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.605744:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.605749:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.605751:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744545.606289:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788744545.606298:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.606309:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.606313:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744545.606319:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.606329:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.606338:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.606346:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.606384:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744545.607071:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744545.607080:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.607098:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.607102:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.607110:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.607215:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.607224:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a748155/0xb6207a6e76dcd708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.607244:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.607246:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.607248:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744545.608281:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744545.608300:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17162:x1875634154569984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788744545.608346:0:19540:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:0.0:1788744545.609060:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.609070:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.609085:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.609089:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.609104:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.610039:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.610055:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.610064:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.610084:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.610588:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.610596:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.610605:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.610609:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.610618:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.610637:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.610644:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4ce14d0/0xb6207a6e76dcd70f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.610667:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.610669:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.610670:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744545.611083:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.611091:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.611101:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.611105:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.611111:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788744545.611293:0:18644:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788744545.611300:0:18644:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788744545.611384:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17882:x1875634154569856:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6665us (132951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744545.611393:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788744545.611489:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744545.611651:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875634154569856:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788744545.611666:0:17882:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788744545.611709:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875634154570112:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788744545.611758:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.611796:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74733bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744545.611813:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570112 00000100:00100000:1.0:1788744545.611819:0:19228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570112 00000100:00100000:1.0:1788744545.611854:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744545.611865:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17882:x1875634154570112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788744545.611892:0:19228:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788744545.611932:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17882:x1875634154570112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.611940:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744545.611982:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875634154570112:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788744545.611993:0:17882:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788744545.612017:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875634154570240:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788744545.612043:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744545.612057:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac74733bd80 going to sleep for 11 seconds 00010000:00010000:0.0:1788744545.612101:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.612201:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.612226:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788744545.612635:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570240 00000100:00100000:3.0:1788744545.612641:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570240 00000100:00100000:3.0:1788744545.612677:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744545.612685:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17882:x1875634154570240:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788744545.612712:0:18644:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788744545.613317:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744545.613326:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613338:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1788744545.613342:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744545.613348:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613361:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613369:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613375:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613391:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744545.613427:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744545.613432:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613447:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dadc00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744545.613451:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613459:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613474:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.613480:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2f5424/0xb6207a6e76dcd716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.625029:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.625042:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.625057:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.625061:0:19539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.625073:0:19539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.625107:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.625125:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b682b35/0xb6207a6e76dcd71d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.625145:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.625147:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.625149:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.626378:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.626389:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.626422:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.626426:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.626433:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.626445:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.626467:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.626474:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.626489:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.630471:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.630485:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.630500:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.630505:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.630516:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.630540:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.630547:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011e4147b/0xb6207a6e76dcd724 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.630581:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.630583:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.630585:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.630985:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.630988:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.630990:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744545.633133:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788744545.633148:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.633165:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788744545.633171:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744545.633177:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.633192:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.633203:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.633220:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.633238:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788744545.634947:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788744545.634961:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.634990:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788744545.634995:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744545.635002:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635016:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635026:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635035:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635061:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788744545.635526:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788744545.635532:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635549:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788744545.635552:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744545.635557:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635568:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635576:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635582:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.635599:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000001:00080000:1.0:1788744545.636318:0:18639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788744545.636365:0:18639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788744545.636412:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744545.636420:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636430:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.636435:0:19539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636445:0:19539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636463:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636471:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1126f6/0xb6207a6e76dcd72b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636488:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744545.636503:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636522:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.636526:0:19539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636533:0:19539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636544:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636551:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f38003/0xb6207a6e76dcd732 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636562:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.636566:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636571:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58200 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.636574:0:19539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636581:0:19539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636591:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636604:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5ee5ff/0xb6207a6e76dcd739 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.636617:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.636619:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.636621:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.637232:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744545.637378:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17162:x1875634154569984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29080us (33553us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788744545.637388:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744545.637902:0:17162:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788744545.637913:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875634154569984:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788744545.637929:0:17162:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:3.0:1788744545.638702:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.638714:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.638732:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.638737:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.638744:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.638759:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.638780:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.638801:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.638818:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744545.640506:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.640681:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.640709:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744545.640901:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788744545.640917:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.640973:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.640980:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.641015:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030800 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.641019:0:19539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.641028:0:19539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.641072:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.641079:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc6d6164/0xb6207a6e76dcd740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.641190:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.641201:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.641349:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.641352:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.641354:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744545.641393:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.641440:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.642473:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.642481:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.642516:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.642929:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.642936:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.642948:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.642978:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.642987:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7b32cf4/0xb6207a6e76dcd747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.643006:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.643008:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.643010:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744545.643387:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744545.643395:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.643436:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1788744545.643440:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744545.643446:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.643458:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.643467:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.643476:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.643496:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.643977:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.643985:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.644005:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030400 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.644009:0:19539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.644018:0:19539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.644032:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.644038:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcd74e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.644058:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.644060:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.644062:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744545.645077:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788744545.645089:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.645103:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788744545.645108:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744545.645114:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.645126:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.645145:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.645153:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.645180:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744545.645260:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.645268:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.645277:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58600 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.645281:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.645290:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.645312:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.645320:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000e4b6de/0xb6207a6e76dcd755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.645336:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.645338:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.645340:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744545.646331:0:18645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788744545.646341:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.646354:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788744545.646358:0:18645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744545.646363:0:18645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.646375:0:18645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.646384:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.646391:0:18645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.646451:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788744545.646508:0:18645:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1788744545.646612:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17164:x1875634154569344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 169879us (170755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744545.646621:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788744545.646733:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744545.646740:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.646748:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744545.646752:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.646761:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.646789:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.646798:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019248ffc/0xb6207a6e76dcd75c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.646827:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.646829:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744545.646830:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744545.647018:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875634154569344:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788744545.647034:0:17164:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788744545.647082:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875634154570368:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788744545.648445:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744545.649002:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac761c2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744545.649032:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570368 00000100:00100000:1.0:1788744545.649040:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570368 00000100:00100000:2.0:1788744545.649288:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744545.649298:0:18642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17164:x1875634154570368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788744545.649347:0:18642:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:3.0:1788744545.660090:0:19457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:3.0:1788744545.660227:0:19457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788744545.660263:0:19457:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788744545.660268:0:19457:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788744545.660725:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875634154570240:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48035us (48675us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788744545.660739:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744545.660809:0:17882:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788744545.660817:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875634154570240:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788744545.660832:0:17882:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788744545.660839:0:18642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17164:x1875634154570368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11467us (12322us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788744545.660848:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744545.660884:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17882:1875634154570496:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788744545.660920:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.660993:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744545.661030:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570496 00000100:00100000:0.0:1788744545.661041:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570496 00000100:00100000:0.0:1788744545.661082:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744545.661089:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1875634154570496:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788744545.661318:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1875634154570496:12345-0@lo:900:osp-pre-1-1.0 Request processed in 229us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744545.661325:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788744545.661369:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac641b78a80 x1875634154570496/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788744561 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744545.661380:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17882:1875634154570496:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788744545.664516:0:17164:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788744545.664531:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875634154570368:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788744545.664550:0:17164:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 10000000:01000000:0.0:1788744545.777273:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744545.777280:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac75575b800 from 10 10000000:01000000:0.0:1788744545.777286:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744545.777335:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.777347:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.777358:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744545.777383:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154570624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744545.777467:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744545.777516:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac761c2f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744545.777634:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570624 00000100:00100000:2.0:1788744545.777643:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570624 00000100:00100000:2.0:1788744545.777698:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788744545.777707:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154570624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744545.777720:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744545.777732:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58400/0xb6207a6e76dcd76a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd763 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.777754:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58400/0xb6207a6e76dcd76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd763 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.777777:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58400/0xb6207a6e76dcd76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd763 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744545.777785:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58400, rc 0) 00000100:00100000:2.0:1788744545.777822:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154570624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744545.777843:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788744545.777990:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154570624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744545.778006:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd76a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.778026:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd76a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744545.778075:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154570752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744545.778109:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744545.779241:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac761c2f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744545.779311:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570752 00000100:00100000:3.0:1788744545.779319:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570752 00000100:00100000:2.0:1788744545.780257:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788744545.780268:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154570752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788744545.780294:0:17130:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744545.780318:0:17130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744545.780321:0:17130:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788744545.780476:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154570752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 209us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744545.780483:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788744545.781234:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154570752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788744545.781311:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744545.781321:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd76a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.781332:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dadc00/0xb6207a6e76dcd763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd76a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744545.781342:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744545.781344:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ac641b52000 from 10 10000000:01000000:3.0:1788744545.781347:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744545.781378:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.781386:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744545.781395:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744545.781446:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154570880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744545.781484:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744545.781535:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac6426180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744545.781650:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154570880 00000100:00100000:1.0:1788744545.781657:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154570880 00000100:00100000:1.0:1788744545.781688:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788744545.781696:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154570880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744545.781708:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744545.781720:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac773f47c00/0xb6207a6e76dcd778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd771 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.781741:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac773f47c00/0xb6207a6e76dcd778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd771 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.781751:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac773f47c00/0xb6207a6e76dcd778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd771 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.781758:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47c00, rc 0) 00000100:00100000:1.0:1788744545.782197:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154570880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 500us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744545.782204:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744545.783000:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154570880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744545.783021:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd778 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744545.783031:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd778 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744545.783097:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154571008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744545.783511:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744545.783715:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac742c6f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744545.784214:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571008 00000100:00100000:2.0:1788744545.784223:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571008 00000100:00100000:2.0:1788744545.784274:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788744545.784283:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154571008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788744545.784304:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744545.784323:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744545.784326:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788744545.785231:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154571008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 946us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744545.785241:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788744545.785417:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154571008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788744545.785489:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744545.785499:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd778 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744545.785510:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac740031000/0xb6207a6e76dcd771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd778 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744546.481349:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744546.991174:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744547.503047:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744548.535429:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744549.551825:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744550.256346:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154571136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744550.256429:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.256505:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571136 00000100:00100000:3.0:1788744550.256512:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571136 00000100:00100000:3.0:1788744550.256561:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744550.256570:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154571136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744550.256604:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744550.256650:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154571136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744550.256656:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744550.256699:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154571136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744550.260315:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154571264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744550.260397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744550.260487:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571264 00000100:00100000:0.0:1788744550.260495:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571264 00000100:00100000:0.0:1788744550.260539:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744550.260549:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154571264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744550.260594:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744550.260636:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154571264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.260662:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744550.260707:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154571264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744550.261309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154571392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744550.261359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.261511:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571392 00000100:00100000:3.0:1788744550.261516:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571392 00000100:00100000:3.0:1788744550.261566:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744550.261574:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154571392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788744550.261595:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788744550.261634:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154571392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744550.261640:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744550.261674:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154571392:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788744550.261848:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788744550.468230:0:19815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788744550.575545:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744550.768546:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154571520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744550.768622:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.768681:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571520 00000100:00100000:1.0:1788744550.768689:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571520 00000100:00100000:1.0:1788744550.769256:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744550.769269:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154571520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744550.769294:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788744550.769999:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744550.770923:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154571520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1653us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744550.770947:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744550.771022:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154571520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744550.772143:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744550.772558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154572288:0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.772622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744550.772653:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154572800:0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.772675:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744550.772692:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154573312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.772714:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.772838:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154571776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744550.772872:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.772897:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154571904:0@lo:400:kworker.0 00000100:00100000:3.0:1788744550.772947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.772974:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154572416:0@lo:400:kworker.0 00000100:00100000:3.0:1788744550.773000:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.773017:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154572928:0@lo:400:kworker.0 00000100:00100000:3.0:1788744550.773041:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.773075:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572416 00000100:00100000:3.0:1788744550.773085:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572416 00000100:00100000:3.0:1788744550.773129:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744550.773138:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154572416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.773682:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154571648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744550.773723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744550.774309:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875634154572416:12345-0@lo:400:kworker.0 Request processed in 1168us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744550.774319:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744550.774377:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875634154572416:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.774870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154572160:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.774919:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.774949:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154572672:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.774971:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.774989:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154573184:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.775011:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.775029:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788744550.775036:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154572032:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.775057:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.775078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154572544:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.775100:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.775117:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154573056:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.775134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744550.775158:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572160 00000100:00100000:3.0:1788744550.775336:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572672 00000100:00100000:3.0:1788744550.775343:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572672 00000100:00100000:3.0:1788744550.775389:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572544 00000100:00100000:3.0:1788744550.775392:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572544 00000100:00100000:3.0:1788744550.775433:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744550.775443:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154572672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744550.775494:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154572672:12345-0@lo:400:kworker.0 Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744550.775502:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744550.775517:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744550.775523:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154572544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744550.775551:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154572544:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744550.775568:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744550.775863:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572288 00000100:00100000:0.0:1788744550.775868:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572288 00000100:00100000:0.0:1788744550.775893:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572800 00000100:00100000:0.0:1788744550.775895:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572800 00000100:00100000:0.0:1788744550.775906:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573312 00000100:00100000:0.0:1788744550.775908:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573312 00000100:00100000:0.0:1788744550.775923:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572928 00000100:00100000:0.0:1788744550.775925:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572928 00000100:00100000:0.0:1788744550.775950:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573184 00000100:00100000:0.0:1788744550.775953:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573184 00000100:00100000:0.0:1788744550.775964:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573056 00000100:00100000:0.0:1788744550.775967:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573056 00000100:00100000:0.0:1788744550.775979:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744550.775986:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154572288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.776031:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875634154572288:12345-0@lo:400:kworker.0 Request processed in 45us (3408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.776048:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744550.776067:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744550.776072:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154572800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.776101:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154572800:12345-0@lo:400:kworker.0 Request processed in 30us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.776107:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744550.776118:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744550.776122:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154573312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.776146:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154573312:12345-0@lo:400:kworker.0 Request processed in 24us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.776152:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744550.776257:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572160 00000100:00100000:1.0:1788744550.776286:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744550.776293:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154572160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.776340:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154572160:12345-0@lo:400:kworker.0 Request processed in 48us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744550.776346:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744550.776394:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154572544:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.776431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154572160:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.776441:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154572672:0@lo:400:kworker.0 00000100:00100000:1.0:1788744550.776471:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571776 00000100:00100000:1.0:1788744550.776475:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571776 00000100:00100000:1.0:1788744550.776498:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571648 00000100:00100000:1.0:1788744550.776501:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571648 00000100:00100000:1.0:1788744550.776513:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744550.776522:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154571776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744550.776542:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788744550.776578:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154571776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (3705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744550.776584:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744550.776595:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744550.776601:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154571648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788744550.776611:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788744550.776639:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154571648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744550.776644:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744550.776677:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154571776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744550.776706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154571648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744550.776918:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744550.776927:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154572928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.776976:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875634154572928:12345-0@lo:400:kworker.0 Request processed in 51us (3933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.776982:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744550.776994:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744550.777000:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154573184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.777033:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875634154573184:12345-0@lo:400:kworker.0 Request processed in 33us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.777038:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744550.777050:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744550.777057:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154573056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.777085:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875634154573056:12345-0@lo:400:kworker.0 Request processed in 30us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.777098:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744550.777125:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154571904 00000100:00100000:0.0:1788744550.777130:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154571904 00000100:00100000:0.0:1788744550.777155:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788744550.777172:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75328d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+24:3644:x1875634154571904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.777204:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75328d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+24:3644:x1875634154571904:12345-0@lo:400:kworker.0 Request processed in 43us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.777210:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788744550.777246:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154572032 00000100:00100000:0.0:1788744550.777250:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154572032 00000100:00100000:0.0:1788744550.777273:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744550.777279:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154572032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.777311:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154572032:12345-0@lo:400:kworker.0 Request processed in 32us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744550.777317:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788744550.777342:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744550.777347:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744550.777351:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788744550.777562:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f28000 x1875634154572288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744550.777574:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875634154572288:0@lo:400:kworker.0 00010000:00080000:0.0:1788744550.777586:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac6435f2680 x1875634154572800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744550.777593:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154572800:0@lo:400:kworker.0 00010000:00080000:0.0:1788744550.777604:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bf480 x1875634154573312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744550.777619:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154573312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.777676:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154571904:0@lo:400:kworker.0 00010000:00080000:0.0:1788744550.777689:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bdc00 x1875634154572928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744550.777697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875634154572928:0@lo:400:kworker.0 00000100:00100000:0.0:1788744550.777723:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154572032:0@lo:400:kworker.0 00010000:00080000:0.0:1788744550.778354:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bdf80 x1875634154573056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744550.778367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875634154573056:0@lo:400:kworker.0 00010000:00080000:0.0:1788744550.778386:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bca80 x1875634154573184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744550.778393:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875634154573184:0@lo:400:kworker.0 00000020:00000004:2.0:1788744551.342329:0:19867:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744551.343096:0:19867:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788744551.600520:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788744552.206511:0:19917:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788744552.206750:0:19917:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788744552.452546:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.452963:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760064 00000100:00100000:2.0:1788744552.452973:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760064 00000100:00100000:2.0:1788744552.453140:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1788744552.453150:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac761f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1875634138760064:12345-192.168.203.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788744552.453197:0:17132:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 97a800c0-99ca-4eb0-8258-5e8a18a17066@192.168.203.4@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:2.0:1788744552.453229:0:17132:0:(genops.c:1384:class_connect()) connect: client 97a800c0-99ca-4eb0-8258-5e8a18a17066, cookie 0xb6207a6e76dcd77f 00000100:00080000:2.0:1788744552.453366:0:17132:0:(import.c:65:import_set_state_nolock()) ffff9ac6422f3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744552.453859:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac761f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+5:2393:x1875634138760064:12345-192.168.203.4@tcp:250:mount.lustre.0 Request processed in 706us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.453870:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:3.0:1788744552.460974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.461086:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760192 00000100:00100000:1.0:1788744552.461097:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760192 00000100:00100000:1.0:1788744552.461158:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:1.0:1788744552.461168:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac761f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+5:14887:x1875634138760192:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744552.461187:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744552.461207:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac773f46c00/0xb6207a6e76dcd786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7f3 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.461237:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac773f46c00/0xb6207a6e76dcd786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7f3 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.461266:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac773f46c00/0xb6207a6e76dcd786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7f3 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.461276:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46c00, rc 0) 00000100:00100000:1.0:1788744552.461338:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac761f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+6:14887:x1875634138760192:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 171us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.461345:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1788744552.466143:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.470064:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760320 00000100:00100000:3.0:1788744552.470079:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760320 00000100:00100000:3.0:1788744552.470209:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:3.0:1788744552.470221:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac761f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+6:14887:x1875634138760320:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788744552.470356:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac761f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+6:14887:x1875634138760320:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 137us (4221us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744552.470364:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:1.0:1788744552.475346:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744552.477788:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760448 00000100:00100000:0.0:1788744552.477803:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760448 00000100:00100000:0.0:1788744552.479095:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:0.0:1788744552.479113:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+6:14887:x1875634138760448:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744552.479132:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744552.479151:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd78d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d7fa expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744552.479180:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7fa expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744552.479205:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dada00/0xb6207a6e76dcd78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d7fa expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744552.479214:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dada00, rc 0) 00000100:00100000:0.0:1788744552.479286:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+7:14887:x1875634138760448:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 179us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744552.479293:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:3.0:1788744552.484331:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.484368:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760576 00000100:00100000:3.0:1788744552.484377:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760576 00000100:00100000:3.0:1788744552.484438:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:3.0:1788744552.484448:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+7:14887:x1875634138760576:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788744552.484607:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14887:x1875634138760576:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 160us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.484616:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:0.0:1788744552.487374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.489998:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760704 00000100:00100000:1.0:1788744552.490014:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760704 00000100:00100000:1.0:1788744552.490081:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:1.0:1788744552.490092:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14887:x1875634138760704:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788744552.490246:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14887:x1875634138760704:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 155us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.490255:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1788744552.501187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.501357:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760832 00000100:00100000:1.0:1788744552.501367:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760832 00000100:00100000:1.0:1788744552.501470:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:1.0:1788744552.501480:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7413f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14906:x1875634138760832:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744552.501636:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7413f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14906:x1875634138760832:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 157us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.501644:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:1.0:1788744552.539470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.539617:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138760960 00000100:00100000:3.0:1788744552.539640:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138760960 00000100:00100000:3.0:1788744552.539696:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:3.0:1788744552.539706:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14906:x1875634138760960:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744552.539949:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14906:x1875634138760960:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 242us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.539961:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:0.0:1788744552.545657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.548747:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761088 00000100:00100000:3.0:1788744552.548762:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761088 00000100:00100000:3.0:1788744552.548834:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1788744552.548844:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75310bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14906:x1875634138761088:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744552.549023:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75310bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14906:x1875634138761088:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 179us (3379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.549032:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1788744552.556891:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.557017:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761216 00000100:00100000:2.0:1788744552.557031:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761216 00000100:00100000:2.0:1788744552.557094:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:2.0:1788744552.557105:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+8:14887:x1875634138761216:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744552.557125:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744552.557156:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b59400/0xb6207a6e76dcd794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d82b expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744552.557188:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b59400/0xb6207a6e76dcd794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d82b expref: 9 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744552.557200:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b59400/0xb6207a6e76dcd794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d82b expref: 9 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744552.557209:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59400, rc 0) 00000100:00100000:2.0:1788744552.557272:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+9:14887:x1875634138761216:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 169us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.557279:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:0.0:1788744552.562760:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.566289:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761344 00000100:00100000:1.0:1788744552.566484:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761344 00000100:00100000:2.0:1788744552.567502:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:2.0:1788744552.567514:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac753108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+9:14887:x1875634138761344:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788744552.567553:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788744552.567568:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788744552.567572:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788744552.567575:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788744552.567578:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788744552.567580:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788744552.570626:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac753108450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+9:14887:x1875634138761344:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 3105us (7868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.570640:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1788744552.575078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.575202:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761472 00000100:00100000:1.0:1788744552.575214:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761472 00000100:00100000:1.0:1788744552.575276:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1788744552.575286:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75310b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+9:14887:x1875634138761472:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744552.575313:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744552.575332:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d832 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.575362:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.575375:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.575385:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47200, rc 0) 00000100:00100000:1.0:1788744552.575477:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75310b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14887:x1875634138761472:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 191us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.575494:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:0.0:1788744552.577521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.577610:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761600 00000100:00100000:2.0:1788744552.577620:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761600 00000100:00100000:2.0:1788744552.577663:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:2.0:1788744552.577672:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7628d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14887:x1875634138761600:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788744552.577836:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7628d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14887:x1875634138761600:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 164us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.577843:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:2.0:1788744552.580674:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744552.580865:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761728 00000100:00100000:0.0:1788744552.580876:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761728 00000100:00100000:0.0:1788744552.580940:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:0.0:1788744552.580952:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7628d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14887:x1875634138761728:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788744552.581120:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7628d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14887:x1875634138761728:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 170us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744552.581129:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1788744552.584663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.586474:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761856 00000100:00100000:1.0:1788744552.586499:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761856 00000100:00100000:1.0:1788744552.586568:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:1.0:1788744552.586579:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14910:x1875634138761856:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744552.586858:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14910:x1875634138761856:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 280us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.586867:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:1.0:1788744552.590525:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.590661:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138761984 00000100:00100000:2.0:1788744552.590671:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138761984 00000100:00100000:2.0:1788744552.590733:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1788744552.590742:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14910:x1875634138761984:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744552.590888:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:14910:x1875634138761984:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 145us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.590896:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1788744552.611585:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.611691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.611818:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762112 00000100:00100000:1.0:1788744552.611833:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762112 00000100:00100000:1.0:1788744552.611878:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762368 00000100:00100000:1.0:1788744552.611883:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762368 00000100:00100000:1.0:1788744552.611913:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788744552.611930:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875634138762112:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788744552.611960:0:17139:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from b2827ee7-baa9-49cc-a7aa-8f8d036c38af@192.168.203.4@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:1.0:1788744552.612007:0:17139:0:(genops.c:1384:class_connect()) connect: client b2827ee7-baa9-49cc-a7aa-8f8d036c38af, cookie 0xb6207a6e76dcd7a2 00000004:00100000:1.0:1788744552.612031:0:17139:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788744552.612249:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788744552.612256:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875634138762368:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788744552.612274:0:17137:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from b2827ee7-baa9-49cc-a7aa-8f8d036c38af@192.168.203.4@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1788744552.612325:0:17137:0:(genops.c:1384:class_connect()) connect: client b2827ee7-baa9-49cc-a7aa-8f8d036c38af, cookie 0xb6207a6e76dcd7a9 00000004:00100000:3.0:1788744552.612339:0:17137:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788744552.612542:0:17137:0:(import.c:65:import_set_state_nolock()) ffff9ac774b60000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744552.612617:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2393:x1875634138762368:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 359us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.612625:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00080000:1.0:1788744552.612988:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9ac64260e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744552.613039:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2393:x1875634138762112:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 1117us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.613047:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00010000:00010000:1.0:1788744552.625258:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744552.633078:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.633121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744552.633209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.633468:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762624 00000100:00100000:3.0:1788744552.633479:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762624 00000100:00100000:3.0:1788744552.633558:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762240 00000100:00100000:3.0:1788744552.633562:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762240 00000100:00100000:3.0:1788744552.633593:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762496 00000100:00100000:3.0:1788744552.633597:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762496 00000100:00100000:3.0:1788744552.633614:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788744552.633625:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:14887:x1875634138762624:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788744552.633665:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744552.633764:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:14887:x1875634138762624:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 139us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.633773:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788744552.633792:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788744552.633800:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:0:x1875634138762240:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788744552.633812:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744552.633835:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:0:x1875634138762240:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 37us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.633841:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788744552.633854:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788744552.633861:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:0:x1875634138762496:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788744552.633879:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788744552.634030:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:0:x1875634138762496:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 167us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.634037:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00080000:2.0:1788744552.635333:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744552.635342:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744552.643689:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744552.646180:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762752 00000100:00100000:0.0:1788744552.646198:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762752 00000100:00100000:0.0:1788744552.646273:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788744552.646282:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14887:x1875634138762752:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744552.646495:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14887:x1875634138762752:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 213us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744552.646503:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788744552.649614:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.649662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744552.649700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.649795:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763136 00000100:00100000:1.0:1788744552.649805:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763136 00000100:00100000:1.0:1788744552.649869:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788744552.649879:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14887:x1875634138763136:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788744552.649966:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14887:x1875634138763136:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.649974:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788744552.650312:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138762880 00000100:00100000:2.0:1788744552.650317:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138762880 00000100:00100000:2.0:1788744552.650344:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763008 00000100:00100000:2.0:1788744552.650346:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763008 00000100:00100000:2.0:1788744552.650366:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788744552.650372:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875634138762880:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788744552.650398:0:18645:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from b2827ee7-baa9-49cc-a7aa-8f8d036c38af@192.168.203.4@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:2.0:1788744552.650462:0:18645:0:(genops.c:1384:class_connect()) connect: client b2827ee7-baa9-49cc-a7aa-8f8d036c38af, cookie 0xb6207a6e76dcd7b0 00002000:00100000:2.0:1788744552.650474:0:18645:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b2827ee7-baa9-49cc-a7aa-8f8d036c38af/ffff9ac6422f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744552.650494:0:18645:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744552.650671:0:18645:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788744552.650700:0:18645:0:(import.c:65:import_set_state_nolock()) ffff9ac6422f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744552.650743:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2393:x1875634138762880:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 370us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.650751:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788744552.650771:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788744552.650776:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875634138763008:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788744552.650793:0:18645:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from b2827ee7-baa9-49cc-a7aa-8f8d036c38af@192.168.203.4@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:2.0:1788744552.650809:0:18645:0:(genops.c:1384:class_connect()) connect: client b2827ee7-baa9-49cc-a7aa-8f8d036c38af, cookie 0xb6207a6e76dcd7b7 00002000:00100000:2.0:1788744552.650815:0:18645:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b2827ee7-baa9-49cc-a7aa-8f8d036c38af/ffff9ac6422f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744552.650842:0:18645:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744552.650964:0:18645:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744552.650980:0:18645:0:(import.c:65:import_set_state_nolock()) ffff9ac6422f3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744552.651006:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2393:x1875634138763008:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 229us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.651012:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788744552.651995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.652250:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763264 00000100:00100000:1.0:1788744552.652259:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763264 00000100:00100000:1.0:1788744552.652316:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744552.652324:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14887:x1875634138763264:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788744552.654484:0:17140:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2049us 00000004:00200000:3.0:1788744552.680387:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788744552.680536:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14887:x1875634138763264:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 28207us (28542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.680551:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788744552.897298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744552.897607:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763392 00000100:00100000:1.0:1788744552.897635:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763392 00000100:00100000:1.0:1788744552.897760:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788744552.897774:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14933:x1875634138763392:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:1.0:1788744552.897797:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744552.897872:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46400/0xb6207a6e76dcd7be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d863 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.897955:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd7c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.897971:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.897987:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744552.898039:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744552.898043:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744552.898082:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.898108:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46400/0xb6207a6e76dcd7be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d863 expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.898126:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d863 expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744552.898135:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:1.0:1788744552.898138:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744552.898142:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46a00, rc 0) 00000100:00100000:1.0:1788744552.898216:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:14933:x1875634138763392:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 446us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.898224:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000040:00080000:3.0:1788744553.199123:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744553.646628:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744554.670708:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744554.839719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744554.839812:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763520 00000100:00100000:3.0:1788744554.839824:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763520 00000100:00100000:3.0:1788744554.839918:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1788744554.839930:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:14986:x1875634138763520:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1788744554.839979:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744554.840083:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:14986:x1875634138763520:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 155us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744554.840098:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00080000:2.0:1788744554.840225:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744554.844251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744554.844332:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763648 00000100:00100000:2.0:1788744554.844344:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763648 00000100:00080000:0.0:1788744554.844594:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744554.844709:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788744554.844723:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14986:x1875634138763648:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1788744554.844762:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788744554.844862:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14986:x1875634138763648:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 142us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744554.844870:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788744554.849726:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744554.849818:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763776 00000100:00100000:1.0:1788744554.849829:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763776 00000100:00100000:1.0:1788744554.849915:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788744554.849924:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14986:x1875634138763776:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1788744554.849955:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788744554.850035:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14986:x1875634138763776:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744554.850042:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:0.0:1788744554.850589:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744554.852301:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744554.852386:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138763904 00000100:00100000:1.0:1788744554.852396:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138763904 00000100:00100000:1.0:1788744554.852489:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788744554.852498:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14986:x1875634138763904:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1788744554.852527:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788744554.852630:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:14986:x1875634138763904:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 132us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744554.852637:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00080000:0.0:1788744554.852753:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744555.012543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.018344:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764032 00000100:00100000:0.0:1788744555.018361:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764032 00000100:00100000:0.0:1788744555.020671:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1788744555.020696:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+10:15019:x1875634138764032:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744555.020789:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744555.020813:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dad200/0xb6207a6e76dcd7cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d86a expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744555.020845:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad200/0xb6207a6e76dcd7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d86a expref: 11 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744555.020857:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dad200/0xb6207a6e76dcd7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d86a expref: 11 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744555.020867:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad200, rc 0) 00000100:00100000:0.0:1788744555.021025:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15019:x1875634138764032:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 340us (8490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.021032:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:3.0:1788744555.027791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744555.027873:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764160 00000100:00100000:1.0:1788744555.027884:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764160 00000100:00100000:1.0:1788744555.027953:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:1.0:1788744555.027964:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15019:x1875634138764160:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788744555.030383:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15019:x1875634138764160:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 2409us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.030595:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:3.0:1788744555.033031:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.033375:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764288 00000100:00100000:2.0:1788744555.033387:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764288 00000100:00100000:2.0:1788744555.033682:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:2.0:1788744555.033695:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15019:x1875634138764288:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788744555.033933:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15019:x1875634138764288:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 240us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.033942:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:3.0:1788744555.037637:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744555.037833:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764416 00000100:00100000:1.0:1788744555.037843:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764416 00000100:00100000:1.0:1788744555.037913:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:1.0:1788744555.037924:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15025:x1875634138764416:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744555.038097:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15025:x1875634138764416:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 174us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.038105:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:3.0:1788744555.057398:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.057575:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764544 00000100:00100000:2.0:1788744555.057585:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764544 00000100:00100000:2.0:1788744555.057653:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:2.0:1788744555.057677:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15025:x1875634138764544:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744555.057839:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15025:x1875634138764544:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 163us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.057847:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:3.0:1788744555.061992:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.062095:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764672 00000100:00100000:0.0:1788744555.062106:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764672 00000100:00100000:0.0:1788744555.062167:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:0.0:1788744555.062178:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15025:x1875634138764672:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744555.062339:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15025:x1875634138764672:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 162us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.062347:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:3.0:1788744555.070105:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744555.070204:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764800 00000100:00100000:1.0:1788744555.070214:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764800 00000100:00100000:1.0:1788744555.070267:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:1.0:1788744555.070277:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:15019:x1875634138764800:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744555.070294:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744555.070312:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac773f46400/0xb6207a6e76dcd7d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d89b expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.070337:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac773f46400/0xb6207a6e76dcd7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d89b expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.070349:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac773f46400/0xb6207a6e76dcd7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d89b expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.070358:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46400, rc 0) 00000100:00100000:1.0:1788744555.070440:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:15019:x1875634138764800:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 165us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.070447:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:3.0:1788744555.078632:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.078738:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138764928 00000100:00100000:2.0:1788744555.078748:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138764928 00000100:00100000:2.0:1788744555.078807:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:2.0:1788744555.078817:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:15019:x1875634138764928:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788744555.078842:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788744555.078867:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788744555.078871:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788744555.078874:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788744555.078877:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788744555.078879:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788744555.081655:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:15019:x1875634138764928:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 2829us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.081670:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:3.0:1788744555.084538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.084635:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765056 00000100:00100000:0.0:1788744555.084647:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765056 00000100:00100000:0.0:1788744555.084705:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:0.0:1788744555.084726:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:15019:x1875634138765056:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744555.084743:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744555.084761:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8a2 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744555.084789:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744555.084802:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744555.084812:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac000, rc 0) 00000100:00100000:0.0:1788744555.084870:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15019:x1875634138765056:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.084878:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1788744555.087078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.087246:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765184 00000100:00100000:2.0:1788744555.087255:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765184 00000100:00100000:2.0:1788744555.087311:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:2.0:1788744555.087321:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15019:x1875634138765184:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788744555.087518:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15019:x1875634138765184:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 198us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.087527:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:3.0:1788744555.090205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744555.090299:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765312 00000100:00100000:1.0:1788744555.090309:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765312 00000100:00100000:1.0:1788744555.090364:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:1.0:1788744555.090374:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15019:x1875634138765312:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788744555.090564:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15019:x1875634138765312:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 190us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.090572:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:3.0:1788744555.092937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.093035:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765440 00000100:00100000:0.0:1788744555.093045:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765440 00000100:00100000:0.0:1788744555.093098:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:0.0:1788744555.093108:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cbf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15030:x1875634138765440:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744555.093261:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cbf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15030:x1875634138765440:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 154us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.093275:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:3.0:1788744555.095672:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.095775:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765568 00000100:00100000:2.0:1788744555.095786:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765568 00000100:00100000:2.0:1788744555.095851:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:2.0:1788744555.095862:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15030:x1875634138765568:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744555.096034:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:15030:x1875634138765568:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 173us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.096043:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:3.0:1788744555.108654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.108696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.108733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.108770:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.108799:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766592 00000100:00100000:3.0:1788744555.108810:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766592 00000100:00100000:3.0:1788744555.108861:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788744555.108870:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138766592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788744555.108952:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138766592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744555.108959:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788744555.108997:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.109071:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.109295:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766720 00000100:00100000:2.0:1788744555.109300:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766720 00000100:00100000:2.0:1788744555.109332:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788744555.109340:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138766720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744555.109380:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138766720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.109386:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788744555.109431:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765696 00000100:00100000:2.0:1788744555.109435:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765696 00000100:00100000:2.0:1788744555.109447:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765952 00000100:00100000:2.0:1788744555.109450:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765952 00000100:00100000:2.0:1788744555.109456:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766336 00000100:00100000:2.0:1788744555.109458:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766336 00000100:00100000:2.0:1788744555.109471:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766464 00000100:00100000:2.0:1788744555.109473:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766464 00000100:00100000:2.0:1788744555.109485:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788744555.109491:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2396:x1875634138766336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744555.109519:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2396:x1875634138766336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.109525:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788744555.109536:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1788744555.109542:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138766464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744555.109578:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138766464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.109584:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1788744555.109595:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788744555.109599:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875634138765696:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788744555.109635:0:17138:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from bdc352e8-3c6b-4f1a-950a-ac93337c2f7b@192.168.203.4@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788744555.109672:0:17138:0:(genops.c:1384:class_connect()) connect: client bdc352e8-3c6b-4f1a-950a-ac93337c2f7b, cookie 0xb6207a6e76dcd7e1 00000004:00100000:2.0:1788744555.109698:0:17138:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788744555.109796:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9ac6433c9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744555.109827:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2393:x1875634138765696:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 226us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.109834:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788744555.109848:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788744555.109852:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875634138765952:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788744555.109867:0:17138:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from bdc352e8-3c6b-4f1a-950a-ac93337c2f7b@192.168.203.4@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788744555.109890:0:17138:0:(genops.c:1384:class_connect()) connect: client bdc352e8-3c6b-4f1a-950a-ac93337c2f7b, cookie 0xb6207a6e76dcd7e8 00000004:00100000:2.0:1788744555.109902:0:17138:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788744555.109960:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9ac643522800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744555.109984:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2393:x1875634138765952:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 130us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.109990:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788744555.115335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.115377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.115460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.115557:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766080 00000100:00100000:0.0:1788744555.115568:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766080 00000100:00100000:0.0:1788744555.115637:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138765824 00000100:00100000:0.0:1788744555.115640:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138765824 00000100:00100000:0.0:1788744555.115656:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766208 00000100:00100000:0.0:1788744555.115659:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766208 00000100:00100000:0.0:1788744555.115675:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788744555.115685:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:0:x1875634138766080:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744555.115731:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744555.115803:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:0:x1875634138766080:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 118us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.115811:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788744555.115828:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788744555.115836:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+7:0:x1875634138765824:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744555.115848:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788744555.115869:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788744555.115879:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+7:0:x1875634138765824:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.115885:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+7:15019:x1875634138766208:12345-192.168.203.4@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788744555.115892:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00080000:3.0:1788744555.116126:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744555.116129:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1788744555.116232:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788744555.116264:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138766208:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 385us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.116271:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788744555.120380:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.120898:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766848 00000100:00100000:0.0:1788744555.120918:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766848 00000100:00100000:0.0:1788744555.120978:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788744555.120988:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138766848:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744555.121118:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138766848:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 131us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.121142:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788744555.147276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.147368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744555.147442:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744555.147505:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138766976 00000100:00100000:3.0:1788744555.147515:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138766976 00000100:00100000:3.0:1788744555.147551:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767104 00000100:00100000:3.0:1788744555.147553:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767104 00000100:00100000:3.0:1788744555.147572:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1788744555.147579:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1875634138766976:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788744555.147611:0:19540:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from bdc352e8-3c6b-4f1a-950a-ac93337c2f7b@192.168.203.4@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788744555.147644:0:19540:0:(genops.c:1384:class_connect()) connect: client bdc352e8-3c6b-4f1a-950a-ac93337c2f7b, cookie 0xb6207a6e76dcd7ef 00002000:00100000:3.0:1788744555.147655:0:19540:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bdc352e8-3c6b-4f1a-950a-ac93337c2f7b/ffff9ac750766000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744555.147678:0:19540:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788744555.147780:0:19540:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744555.147810:0:19540:0:(import.c:65:import_set_state_nolock()) ffff9ac750760000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744555.147879:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2393:x1875634138766976:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 299us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744555.147886:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1788744555.147913:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788744555.147918:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1875634138767104:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788744555.147935:0:19540:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from bdc352e8-3c6b-4f1a-950a-ac93337c2f7b@192.168.203.4@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788744555.147952:0:19540:0:(genops.c:1384:class_connect()) connect: client bdc352e8-3c6b-4f1a-950a-ac93337c2f7b, cookie 0xb6207a6e76dcd7f6 00002000:00100000:3.0:1788744555.147958:0:19540:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bdc352e8-3c6b-4f1a-950a-ac93337c2f7b/ffff9ac750766800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744555.147964:0:19540:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788744555.148006:0:19540:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788744555.148020:0:19540:0:(import.c:65:import_set_state_nolock()) ffff9ac750761800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744555.148044:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2393:x1875634138767104:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 123us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744555.148050:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788744555.149534:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767232 00000100:00100000:1.0:1788744555.149546:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767232 00000100:00100000:1.0:1788744555.149609:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788744555.149619:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138767232:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788744555.152014:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138767232:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 2385us (4735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.152029:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788744555.154378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744555.154612:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767360 00000100:00100000:0.0:1788744555.154627:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767360 00000100:00100000:0.0:1788744555.154693:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788744555.154703:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138767360:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788744555.154822:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788744555.154927:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15019:x1875634138767360:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 224us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.154935:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788744555.331816:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744555.331999:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767488 00000100:00100000:1.0:1788744555.332010:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767488 00000100:00100000:1.0:1788744555.332080:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788744555.332091:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15053:x1875634138767488:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:1.0:1788744555.332111:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744555.332130:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8d3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.332196:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.332211:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.332244:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744555.332289:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744555.332294:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744555.332315:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.332341:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.332358:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744555.332367:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:1.0:1788744555.332370:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744555.332374:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47800, rc 0) 00000100:00100000:1.0:1788744555.332644:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+7:15053:x1875634138767488:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 553us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.332652:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788744555.374888:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154573440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744555.374975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744555.375586:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573440 00000100:00100000:0.0:1788744555.375598:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573440 00000100:00100000:0.0:1788744555.375664:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744555.375675:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154573440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744555.375712:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744555.375767:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154573440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.375773:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744555.375826:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154573440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744555.376331:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744555.376345:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154573568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744555.376384:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744555.376623:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154573696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744555.376652:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744555.376727:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573696 00000100:00100000:1.0:1788744555.376732:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573696 00000100:00100000:1.0:1788744555.376774:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744555.376781:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154573696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744555.376805:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788744555.376860:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154573696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.376867:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744555.376947:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154573696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744555.377134:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573568 00000100:00100000:2.0:1788744555.377139:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573568 00000100:00100000:2.0:1788744555.377225:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744555.377234:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154573568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744555.377248:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744555.377293:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154573568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.377299:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744555.377438:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154573568:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788744555.377578:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744555.694737:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744555.886766:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744555.886791:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154573824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744555.886857:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744555.887080:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744555.887090:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154573952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744555.887119:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744555.887655:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573824 00000100:00100000:0.0:1788744555.887664:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573824 00000100:00100000:0.0:1788744555.887716:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154573952 00000100:00100000:0.0:1788744555.887719:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154573952 00000100:00100000:0.0:1788744555.887736:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744555.887757:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154573824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744555.887780:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788744555.887827:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154573824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.887833:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744555.887850:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744555.887856:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154573952:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788744555.887971:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744555.888031:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154573824:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744555.889016:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788744555.889149:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154573952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1290us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.889156:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744555.889434:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744555.889448:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154574080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744555.889488:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744555.889535:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574080 00000100:00100000:2.0:1788744555.889542:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574080 00000100:00100000:2.0:1788744555.889584:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744555.889592:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154574080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744555.889608:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744555.889656:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154574080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744555.889663:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788744555.889680:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744555.889709:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154574080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744555.898823:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154574464:0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.898891:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744555.898935:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154574976:0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.898955:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744555.898973:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788744555.898978:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154574336:0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.898996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744555.899009:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154574848:0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744555.899049:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574464 00000100:00100000:0.0:1788744555.899056:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574464 00000100:00100000:0.0:1788744555.899095:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574976 00000100:00100000:0.0:1788744555.899097:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574976 00000100:00100000:0.0:1788744555.899117:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574336 00000100:00100000:0.0:1788744555.899119:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574336 00000100:00100000:0.0:1788744555.899146:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574848 00000100:00100000:0.0:1788744555.899149:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574848 00000100:00100000:0.0:1788744555.899166:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744555.899174:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154574464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899228:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875634154574464:12345-0@lo:400:kworker.0 Request processed in 54us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.899235:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744555.899252:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744555.899271:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154574976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899300:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875634154574976:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.899306:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744555.899319:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744555.899325:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154574336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899349:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154574336:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.899354:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744555.899365:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744555.899370:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154574848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899395:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154574848:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744555.899430:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744555.899465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154574336:0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899477:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154574848:0@lo:400:kworker.0 00000100:00100000:0.0:1788744555.899485:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875634154574464:0@lo:400:kworker.0 00010000:00080000:0.0:1788744555.899505:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4bc700 x1875634154574976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744555.899516:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875634154574976:0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900179:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154574592:0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900225:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744555.900270:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744555.900276:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154574208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900307:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744555.900335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac75d4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154574720:0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900357:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744555.900380:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574592 00000100:00100000:1.0:1788744555.900385:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574592 00000100:00100000:1.0:1788744555.900434:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574720 00000100:00100000:1.0:1788744555.900438:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574720 00000100:00100000:1.0:1788744555.900455:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744555.900463:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154574592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900504:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154574592:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.900511:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744555.900525:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744555.900531:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154574720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900557:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154574720:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.900562:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788744555.900608:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac75d4be680 x1875634154574720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744555.900619:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154574720:0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900629:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154574592:0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900658:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154574208 00000100:00100000:1.0:1788744555.900662:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154574208 00000100:00100000:1.0:1788744555.900686:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788744555.900693:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:3645:x1875634154574208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744555.900728:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:3645:x1875634154574208:12345-0@lo:400:kworker.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744555.900733:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788744555.900758:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac75d4bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3734829d-853b-494e-83d0-e0bd2808e668:3645:1875634154574208:0@lo:400:kworker.0 00000100:00080000:2.0:1788744555.903656:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744555.903669:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744555.905588:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154573952:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788744556.207066:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744556.719465:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744557.751377:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744558.041085:0:20015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788744558.453535:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bdc352e8-3c6b-4f1a-950a-ac93337c2f7b 00000001:00100000:2.0:1788744558.453553:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b2827ee7-baa9-49cc-a7aa-8f8d036c38af 00000001:00100000:1.0:1788744558.454966:0:18639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdc352e8-3c6b-4f1a-950a-ac93337c2f7b 00000001:00100000:1.0:1788744558.454979:0:18639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2827ee7-baa9-49cc-a7aa-8f8d036c38af 00000001:00100000:2.0:1788744558.456480:0:19457:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdc352e8-3c6b-4f1a-950a-ac93337c2f7b 00000001:00100000:2.0:1788744558.456491:0:19457:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2827ee7-baa9-49cc-a7aa-8f8d036c38af 00000001:00100000:2.0:1788744558.460221:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bdc352e8-3c6b-4f1a-950a-ac93337c2f7b 00000001:00100000:2.0:1788744558.460234:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b2827ee7-baa9-49cc-a7aa-8f8d036c38af 00010000:00010000:1.0:1788744558.767214:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744559.791575:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744560.494598:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744560.494622:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154575104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744560.494708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744560.494771:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575104 00000100:00100000:3.0:1788744560.494779:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575104 00000100:00100000:3.0:1788744560.494828:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744560.494837:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154575104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744560.495004:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788744560.495053:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154575104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 217us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744560.495060:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744560.495105:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154575104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744560.496584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154575232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744560.496634:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744560.496702:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575232 00000100:00100000:2.0:1788744560.496709:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575232 00000100:00100000:2.0:1788744560.496762:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744560.496771:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154575232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744560.496797:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744560.496839:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154575232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744560.496845:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788744560.496997:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744560.497029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154575232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744560.502182:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154575360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744560.502257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744560.503301:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575360 00000100:00100000:3.0:1788744560.503313:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575360 00000100:00100000:3.0:1788744560.503370:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744560.503380:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154575360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744560.503447:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788744560.503516:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154575360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744560.503524:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744560.503570:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154575360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744560.651615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651668:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651691:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651764:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651786:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651811:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651841:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744560.651893:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768000 00000100:00100000:0.0:1788744560.651904:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768000 00000100:00100000:0.0:1788744560.651967:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768512 00000100:00100000:0.0:1788744560.651971:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768512 00000100:00100000:0.0:1788744560.651985:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768128 00000100:00100000:0.0:1788744560.651988:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768128 00000100:00100000:1.0:1788744560.652079:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767744 00000100:00100000:1.0:1788744560.652085:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767744 00000100:00100000:1.0:1788744560.652110:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768256 00000100:00100000:1.0:1788744560.652113:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768256 00000100:00100000:1.0:1788744560.652125:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767872 00000100:00100000:1.0:1788744560.652128:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767872 00000100:00100000:1.0:1788744560.652139:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768384 00000100:00100000:1.0:1788744560.652141:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768384 00000100:00100000:1.0:1788744560.652168:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788744560.652179:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2397:x1875634138767744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744560.652255:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2397:x1875634138767744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744560.652263:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788744560.652281:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:1.0:1788744560.652288:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2397:x1875634138768256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744560.652315:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2397:x1875634138768256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744560.652321:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:1.0:1788744560.652332:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788744560.652339:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138767872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744560.652362:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138767872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744560.652368:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788744560.652380:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788744560.652386:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138768384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.652665:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768640 00000100:00100000:0.0:1788744560.652671:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768640 00000100:00100000:0.0:1788744560.652689:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788744560.652696:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138768000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.652729:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138768000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.652735:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788744560.652748:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788744560.652754:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138768512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.652785:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138768512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.652791:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788744560.652803:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788744560.652808:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac75d4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138768128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.652827:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138768128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.652833:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788744560.652844:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788744560.652850:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138768640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.653555:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138768640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 702us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.653562:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788744560.653591:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138767616 00000100:00100000:0.0:1788744560.653597:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138767616 00000100:00100000:0.0:1788744560.653646:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:0.0:1788744560.653654:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:2397:x1875634138767616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.653676:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:2397:x1875634138767616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.653682:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00080000:0.0:1788744560.653720:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788744560.653724:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744560.653726:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744560.653728:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744560.653951:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac75d4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138768384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744560.653961:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00010000:00010000:1.0:1788744560.818782:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744561.008127:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744561.008208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.008277:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575488 00000100:00100000:2.0:1788744561.008285:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575488 00000100:00100000:2.0:1788744561.008786:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744561.008797:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154575488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744561.008820:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744561.008876:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154575488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.008883:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788744561.008907:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744561.008943:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744561.013752:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154575616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744561.013819:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.013885:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575616 00000100:00100000:2.0:1788744561.013893:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575616 00000100:00100000:2.0:1788744561.013941:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744561.013950:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154575616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744561.013978:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788744561.014023:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875634154575616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.014031:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788744561.014059:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744561.014094:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6424c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875634154575616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744561.015958:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154575744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744561.016028:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744561.016148:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575744 00000100:00100000:1.0:1788744561.016156:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575744 00000100:00100000:1.0:1788744561.016218:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744561.016227:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154575744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744561.016270:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788744561.016327:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154575744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.016334:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788744561.018733:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744561.018802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154575744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744561.020639:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154576128:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.020743:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.020794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154576640:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.020819:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.020846:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744561.020853:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154576256:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.020886:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.020926:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154576128 00000100:00100000:2.0:1788744561.020934:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154576128 00000100:00100000:2.0:1788744561.020978:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154576640 00000100:00100000:2.0:1788744561.020980:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154576640 00000100:00100000:2.0:1788744561.021004:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154576256 00000100:00100000:2.0:1788744561.021007:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154576256 00000100:00100000:2.0:1788744561.021022:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744561.021030:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154576128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021083:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875634154576128:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021094:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744561.021114:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744561.021119:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154576640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021146:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875634154576640:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021152:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744561.021163:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744561.021169:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154576256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021212:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875634154576256:12345-0@lo:400:kworker.0 Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021217:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788744561.021249:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744561.021254:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744561.021266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154576000:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021303:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.021321:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154576512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021342:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.021355:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788744561.021361:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154575872:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021385:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.021451:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154576384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021472:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.021492:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154575872 00000100:00100000:2.0:1788744561.021495:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154575872 00000100:00100000:2.0:1788744561.021521:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744561.021528:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:3644:x1875634154575872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021562:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+24:3644:x1875634154575872:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021568:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744561.021597:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154576000 00000100:00100000:2.0:1788744561.021600:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154576000 00000100:00100000:2.0:1788744561.021615:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154576512 00000100:00100000:2.0:1788744561.021618:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154576512 00000100:00100000:2.0:1788744561.021635:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154576384 00000100:00100000:2.0:1788744561.021638:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154576384 00000100:00100000:2.0:1788744561.021663:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744561.021669:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154576000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021698:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875634154576000:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021704:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744561.021716:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744561.021721:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154576512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021747:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875634154576512:12345-0@lo:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021752:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744561.021764:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744561.021771:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154576384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021795:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875634154576384:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744561.021800:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788744561.021813:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744561.021815:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744561.021845:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3734829d-853b-494e-83d0-e0bd2808e668:3644:1875634154575872:0@lo:400:kworker.0 00010000:00080000:2.0:1788744561.021859:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f2b100 x1875634154576384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744561.021882:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875634154576384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875634154576000:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021902:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875634154576512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875634154576256:0@lo:400:kworker.0 00000100:00100000:2.0:1788744561.021958:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac745072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875634154576128:0@lo:400:kworker.0 00010000:00080000:2.0:1788744561.021968:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac643f2a680 x1875634154576640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744561.021977:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875634154576640:0@lo:400:kworker.0 00000020:00000080:1.0:1788744561.584959:0:20162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce4294a90 20000000:00000080:1.0:1788744561.584976:0:20162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac77fa90c00 uarg=0000000000000000 20000000:01000000:1.0:1788744561.585018:0:20162:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744561.585024:0:20162:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744561.585030:0:20162:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788744561.585878:0:20163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788744561.586050:0:20162:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788744561.594558:0:20162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744561.594804:0:20162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.594825:0:20162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.594834:0:20162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.594840:0:20162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.594847:0:20162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.594856:0:20162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.595062:0:20162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 12 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.595071:0:20162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.595128:0:20162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 12 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.595142:0:20162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 12 pid: 17130 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.595158:0:20162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154576768:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744561.595360:0:20162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.595368:0:20162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 12 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.595377:0:20162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154576896:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744561.595444:0:20162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.595452:0:20162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 23 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.595460:0:20162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577024:0@lo:104: 00000100:00100000:2.0:1788744561.596015:0:20162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744561.596066:0:20162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.596076:0:20162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 23 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.596099:0:20162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577152:0@lo:104: 00000100:00100000:2.0:1788744561.596124:0:20162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744561.596149:0:20162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.596157:0:20162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 23 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.596164:0:20162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577280:0@lo:104: 00000100:00100000:2.0:1788744561.596182:0:20162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744561.596196:0:20162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.596203:0:20162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 23 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.596222:0:20162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577408:0@lo:104: 00000100:00100000:2.0:1788744561.596242:0:20162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744561.596252:0:20162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774b4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744561.596395:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577024 00000100:00100000:1.0:1788744561.596434:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577024 00000100:00100000:1.0:1788744561.596485:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577152 00000100:00100000:1.0:1788744561.596488:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577152 00000100:00100000:1.0:1788744561.596500:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577280 00000100:00100000:1.0:1788744561.596502:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577280 00000100:00100000:1.0:1788744561.596512:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577408 00000100:00100000:1.0:1788744561.596514:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577408 00000100:00100000:1.0:1788744561.596526:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744561.596536:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+6:20162:x1875634154577024:12345-0@lo:104: 00010000:00010000:1.0:1788744561.596548:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596608:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744561.596614:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+6:20162:x1875634154577024:12345-0@lo:104: Request processed in 81us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.596621:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744561.596639:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744561.596654:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+5:20162:x1875634154577152:12345-0@lo:104: 00010000:00010000:1.0:1788744561.596674:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596710:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744561.596715:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+5:20162:x1875634154577152:12345-0@lo:104: Request processed in 63us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.596721:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744561.596735:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744561.596742:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+4:20162:x1875634154577280:12345-0@lo:104: 00010000:00010000:1.0:1788744561.596750:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596781:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788744561.596786:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+4:20162:x1875634154577280:12345-0@lo:104: Request processed in 45us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.596792:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744561.596805:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744561.596810:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+3:20162:x1875634154577408:12345-0@lo:104: 00010000:00010000:1.0:1788744561.596817:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596842:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788744561.596847:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3734829d-853b-494e-83d0-e0bd2808e668+3:20162:x1875634154577408:12345-0@lo:104: Request processed in 38us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.596853:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788744561.596882:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788744561.596894:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596902:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bf800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744561.596907:0:19539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596916:0:19539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744561.596923:0:19539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744561.596928:0:19539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744561.596956:0:19539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.596963:0:19539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744561.596983:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597001:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bf800/0xb6207a6e76dcd580 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd587 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597014:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744561.597017:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597022:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac6437bea00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744561.597025:0:19539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597041:0:19539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744561.597048:0:19539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744561.597053:0:19539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744561.597067:0:19539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597072:0:19539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744561.597087:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597093:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac6437bea00/0xb6207a6e76dcd4e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4ed expref: -99 pid: 18638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597102:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744561.597105:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597110:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac741535c00 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744561.597113:0:19539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597119:0:19539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744561.597124:0:19539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744561.597135:0:19539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744561.597148:0:19539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597154:0:19539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744561.597160:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597165:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac741535c00/0xb6207a6e76dcd4a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4ae expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597174:0:19539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744561.597177:0:19539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597181:0:19539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59800 already unused, calling callback (ffffffffc14dbc20) 10000000:00010000:1.0:1788744561.597184:0:19539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597189:0:19539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744561.597194:0:19539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744561.597199:0:19539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744561.597209:0:19539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597215:0:19539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744561.597227:0:19539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597233:0:19539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9ac774b59800/0xb6207a6e76dcd499 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb6207a6e76dcd4a0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597245:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744561.597246:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744561.597248:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744561.597256:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744561.597262:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744561.597280:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3734829d-853b-494e-83d0-e0bd2808e668:3646:1875634154577536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.597313:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744561.597338:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744561.597345:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3734829d-853b-494e-83d0-e0bd2808e668:3646:1875634154577920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.597366:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744561.597392:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154577664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.597433:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744561.597451:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744561.597457:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154577792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.597477:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744561.597536:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577536 00000100:00100000:1.0:1788744561.597542:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577536 00010000:00010000:1.0:1788744561.597560:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 24 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744561.597575:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577920 00000100:00100000:1.0:1788744561.597578:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577920 00010000:00010000:1.0:1788744561.597589:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 25 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744561.597606:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577664 00000100:00100000:1.0:1788744561.597609:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577664 00010000:00010000:1.0:1788744561.597621:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 26 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744561.597630:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154577792 00000100:00100000:1.0:1788744561.597633:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154577792 00010000:00010000:1.0:1788744561.597643:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 27 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744561.597655:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744561.597662:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+27:3646:x1875634154577536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744561.597673:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744561.597679:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 27 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597687:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 27 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597704:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744561.597733:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+27:3646:x1875634154577536:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.597739:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744561.597754:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744561.597760:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+26:3646:x1875634154577920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744561.597767:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744561.597772:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 26 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597790:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 26 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597800:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744561.597823:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+26:3646:x1875634154577920:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.597829:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744561.597842:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744561.597848:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+25:3643:x1875634154577664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744561.597855:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744561.597860:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 25 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597885:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 25 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597894:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744561.597921:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+25:3643:x1875634154577664:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.597927:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744561.597939:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744561.597945:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+24:3643:x1875634154577792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744561.597953:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744561.597957:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 24 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597965:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 24 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.597980:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744561.598004:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3734829d-853b-494e-83d0-e0bd2808e668+24:3643:x1875634154577792:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.598010:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744561.598048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154577792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.598056:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154577664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.598080:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3734829d-853b-494e-83d0-e0bd2808e668:3646:1875634154577920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744561.598087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3734829d-853b-494e-83d0-e0bd2808e668:3646:1875634154577536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744561.598707:0:20162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b58c00/0xb6207a6e76dcd587 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd580 expref: 23 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.598723:0:20162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577024:0@lo:104: 00010000:00010000:2.0:1788744561.598734:0:20162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd4ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd4e6 expref: 22 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.598742:0:20162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577152:0@lo:104: 00010000:00010000:2.0:1788744561.598749:0:20162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac6437bfa00/0xb6207a6e76dcd4ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd4a7 expref: 21 pid: 17131 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.598766:0:20162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577280:0@lo:104: 00010000:00010000:2.0:1788744561.598775:0:20162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac741535400/0xb6207a6e76dcd4a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb6207a6e76dcd499 expref: 20 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744561.598783:0:20162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154577408:0@lo:104: 00000100:00100000:2.0:1788744561.617963:0:20162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154576768:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788744561.617979:0:20162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20162:1875634154576896:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788744561.618014:0:20162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744561.619137:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744561.619572:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744561.619775:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768896 00000100:00100000:1.0:1788744561.619785:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768896 00010000:00010000:1.0:1788744561.619819:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 13 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744561.619857:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138768768 00000100:00100000:1.0:1788744561.619869:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138768768 00010000:00010000:1.0:1788744561.619882:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 14 pid: 17130 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744561.619897:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788744561.619906:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7616f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97a800c0-99ca-4eb0-8258-5e8a18a17066+14:2395:x1875634138768896:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744561.619919:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744561.619924:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 14 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.619935:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 14 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.619961:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac773f47200/0xb6207a6e76dcd79b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d832 expref: 14 pid: 17132 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.619979:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744561.620036:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7616f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:2395:x1875634138768896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 130us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.620043:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788744561.620100:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788744561.620109:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:2395:x1875634138768768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744561.620116:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744561.620120:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 12 pid: 17130 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620130:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 12 pid: 17130 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620141:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac643dac000/0xb6207a6e76dcd7da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8a2 expref: 12 pid: 17130 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620153:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620161:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620176:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620193:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620200:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620207:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620223:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744561.620227:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620235:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620246:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.620255:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744561.620275:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:2395:x1875634138768768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 168us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744561.620282:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:2.0:1788744561.620359:0:20162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.620367:0:20162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744561.620373:0:20162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac774b59a00/0xb6207a6e76dcd80b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744561.847114:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744562.802734:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744562.802742:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac6431c3800 from 13 10000000:01000000:2.0:1788744562.802747:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744562.802799:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.802817:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.802844:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744562.802881:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.802946:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.803338:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744562.808698:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578048 00000100:00100000:0.0:1788744562.808713:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578048 00000100:00100000:0.0:1788744562.808773:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744562.808784:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+20:17135:x1875634154578048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744562.808801:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744562.808822:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dad400/0xb6207a6e76dcd819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd812 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.808850:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad400/0xb6207a6e76dcd819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd812 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.808873:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dad400/0xb6207a6e76dcd819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd812 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.808882:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad400, rc 0) 00000100:00100000:0.0:1788744562.808961:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154578048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (6013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.808968:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744562.809023:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744562.809041:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd819 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.809051:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd819 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744562.809129:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.809165:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.809204:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744562.809218:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578176 00000100:00100000:0.0:1788744562.809222:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578176 00000100:00100000:0.0:1788744562.809272:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744562.809279:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154578176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.809390:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154578176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.809397:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744562.809466:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.809507:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.809546:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.809559:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744562.809582:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578304 00000100:00100000:0.0:1788744562.809585:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578304 00000100:00100000:0.0:1788744562.809603:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788744562.809609:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154578304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.809685:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154578304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.809693:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788744562.809729:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744562.810371:0:20210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788744562.810551:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788744562.810576:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744562.810584:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd819 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810610:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b58c00/0xb6207a6e76dcd812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd819 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744562.810622:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744562.810624:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac77cadb000 from 13 10000000:01000000:0.0:1788744562.810627:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744562.810653:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810661:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810669:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744562.810684:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.810721:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.810739:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744562.810752:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578432 00000100:00100000:0.0:1788744562.810757:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578432 00000100:00100000:0.0:1788744562.810785:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788744562.810793:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+21:17135:x1875634154578432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744562.810802:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744562.810812:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd827 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd820 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810831:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd820 expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810866:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dad800/0xb6207a6e76dcd827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd820 expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810874:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad800, rc 0) 00000100:00100000:0.0:1788744562.810905:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154578432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.810911:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788744562.810944:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744562.810955:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd827 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744562.810963:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd827 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744562.811004:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.811028:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.811040:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744562.811050:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578560 00000100:00100000:0.0:1788744562.811053:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578560 00000100:00100000:0.0:1788744562.811072:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788744562.811079:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154578560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.811161:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154578560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.811168:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788744562.811197:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.811231:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.811265:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.811277:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744562.811288:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578688 00000100:00100000:0.0:1788744562.811291:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578688 00000100:00100000:0.0:1788744562.811310:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788744562.811315:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154578688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744562.811390:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154578688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.811423:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788744562.811468:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744562.814176:0:20211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788744562.814649:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788744562.814672:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744562.814684:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd827 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744562.814697:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac643dac800/0xb6207a6e76dcd820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd827 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744562.814723:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744562.814726:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac75575b800 from 13 10000000:01000000:1.0:1788744562.814729:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744562.814771:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744562.814780:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744562.814792:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744562.814821:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744562.814902:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744562.814944:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744562.815043:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578816 00000100:00100000:2.0:1788744562.815050:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578816 00000100:00100000:2.0:1788744562.815088:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788744562.815099:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+22:17135:x1875634154578816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744562.815112:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744562.815126:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58200/0xb6207a6e76dcd835 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd82e expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.815148:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58200/0xb6207a6e76dcd835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd82e expref: 23 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.815159:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58200/0xb6207a6e76dcd835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd82e expref: 23 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.815169:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58200, rc 0) 00000100:00100000:2.0:1788744562.815209:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154578816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.815217:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788744562.815572:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744562.815588:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd835 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744562.815597:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd835 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744562.815660:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744562.815689:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744562.815718:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744562.815884:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154578944 00000100:00100000:2.0:1788744562.815889:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154578944 00000100:00100000:2.0:1788744562.815944:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744562.815952:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154578944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.816071:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154578944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.816078:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788744562.816184:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154578944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744562.816228:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744562.816556:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744562.816799:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744562.817213:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154579072 00000100:00100000:2.0:1788744562.817220:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154579072 00000100:00100000:2.0:1788744562.817374:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744562.817384:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154579072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.817522:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154579072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.817528:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788744562.817627:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643e44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744562.823020:0:20213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788744562.823089:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788744562.823114:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744562.823128:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd835 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823140:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac773f47a00/0xb6207a6e76dcd82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd835 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744562.823150:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744562.823153:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ac641b52000 from 13 10000000:01000000:2.0:1788744562.823156:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744562.823194:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823201:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823226:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744562.823258:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.823322:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.823358:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744562.823380:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154579200 00000100:00100000:2.0:1788744562.823386:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154579200 00000100:00100000:2.0:1788744562.823456:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788744562.823468:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77cdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+23:17135:x1875634154579200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744562.823485:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744562.823500:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58600/0xb6207a6e76dcd843 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb6207a6e76dcd83c expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823525:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58600/0xb6207a6e76dcd843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb6207a6e76dcd83c expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823536:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58600/0xb6207a6e76dcd843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb6207a6e76dcd83c expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823545:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58600, rc 0) 00000100:00100000:2.0:1788744562.823585:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77cdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154579200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.823592:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788744562.823643:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744562.823659:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd843 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.823676:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb6207a6e76dcd843 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744562.823731:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.823761:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.823779:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744562.823792:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154579328 00000100:00100000:2.0:1788744562.823795:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154579328 00000100:00100000:2.0:1788744562.823817:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788744562.823824:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154579328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.823943:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154579328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.823950:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788744562.823986:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.824015:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.824057:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.824072:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac745579540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744562.824084:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154579456 00000100:00100000:2.0:1788744562.824088:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154579456 00000100:00100000:2.0:1788744562.824109:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788744562.824115:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154579456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744562.824196:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3734829d-853b-494e-83d0-e0bd2808e668+24:17135:x1875634154579456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.824204:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788744562.824253:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6431ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3734829d-853b-494e-83d0-e0bd2808e668:17135:1875634154579456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788744562.829159:0:20214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788744562.829679:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788744562.829705:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744562.829717:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd843 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.829730:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9ac774b59600/0xb6207a6e76dcd83c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb6207a6e76dcd843 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744562.863380:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744563.440866:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788744563.531083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744563.531325:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769024 00000100:00100000:2.0:1788744563.531336:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769024 00000100:00100000:2.0:1788744563.531524:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:2.0:1788744563.531536:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+11:14902:x1875634138769024:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744563.531555:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744563.531576:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac774b58a00/0xb6207a6e76dcd84a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8da expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744563.531609:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac774b58a00/0xb6207a6e76dcd84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8da expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744563.531623:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac774b58a00/0xb6207a6e76dcd84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8da expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744563.531641:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58a00, rc 0) 00000100:00100000:2.0:1788744563.531724:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:14902:x1875634138769024:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 190us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744563.531731:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:0.0:1788744563.534924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744563.535074:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769152 00000100:00100000:3.0:1788744563.535084:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769152 00000100:00100000:3.0:1788744563.535142:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:3.0:1788744563.535154:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:14902:x1875634138769152:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744563.535313:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:14902:x1875634138769152:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 161us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744563.535322:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:1.0:1788744563.537889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744563.537990:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769280 00000100:00100000:2.0:1788744563.538002:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769280 00000100:00100000:2.0:1788744563.538104:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:2.0:1788744563.538116:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:14902:x1875634138769280:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744563.538276:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:14902:x1875634138769280:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 161us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744563.538286:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:2.0:1788744563.542806:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744563.543229:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769408 00000100:00100000:0.0:1788744563.543239:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769408 00000100:00100000:0.0:1788744563.543296:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:0.0:1788744563.543306:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+12:14902:x1875634138769408:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744563.543325:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744563.543342:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd851 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8e1 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744563.543369:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8e1 expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744563.543380:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac643dad000/0xb6207a6e76dcd851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8e1 expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744563.543455:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad000, rc 0) 00000100:00100000:0.0:1788744563.543510:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:14902:x1875634138769408:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 205us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744563.543522:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:0.0:1788744563.546379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744563.546560:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769536 00000100:00100000:2.0:1788744563.546571:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769536 00000100:00100000:2.0:1788744563.547693:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1788744563.547711:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:14902:x1875634138769536:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744563.547946:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:14902:x1875634138769536:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 241us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744563.547955:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:1.0:1788744563.551335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744563.556173:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769664 00000100:00100000:0.0:1788744563.556187:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769664 00000100:00100000:0.0:1788744563.556241:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:0.0:1788744563.556252:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:14902:x1875634138769664:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744563.556393:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:14902:x1875634138769664:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 141us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744563.557092:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00010000:00010000:1.0:1788744563.887915:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744564.911266:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744565.257272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.257371:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769792 00000100:00100000:0.0:1788744565.257381:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769792 00000100:00100000:0.0:1788744565.257627:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788744565.257637:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:15568:x1875634138769792:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744565.257656:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744565.257675:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8e8 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257731:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257744:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257782:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257796:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257804:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257810:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257894:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd86d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257909:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd86d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257916:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd86d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744565.257944:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788744565.257947:0:17137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744565.257979:0:17137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd86d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257989:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.257996:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258203:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258210:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744565.258214:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258222:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258233:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:0.0:1788744565.258236:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744565.258241:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258247:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd85f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258260:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258266:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258272:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258277:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744565.258279:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258294:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258301:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ac6424c9000) 00010000:00010000:0.0:1788744565.258303:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744565.258305:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258311:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd866 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258339:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8e8 expref: 8 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258362:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac200/0xb6207a6e76dcd86d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8e8 expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.258369:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac6424c9100) 00010000:00010000:0.0:1788744565.258371:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744565.258374:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac200, rc 0) 00000100:00100000:0.0:1788744565.258477:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:15568:x1875634138769792:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 841us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744565.258484:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00080000:2.0:1788744565.264024:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744565.275333:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.275453:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138769920 00000100:00100000:2.0:1788744565.275464:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138769920 00000100:00100000:2.0:1788744565.275522:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788744565.275533:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:15568:x1875634138769920:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788744565.275627:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:15568:x1875634138769920:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744565.275635:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788744565.289361:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.289625:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138770176 00000100:00100000:0.0:1788744565.289635:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138770176 00000100:00100000:0.0:1788744565.289704:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1788744565.289714:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:15568:x1875634138770176:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744565.289750:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744565.289770:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd874 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8ef expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.289856:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.289871:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.289881:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.289896:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.289902:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.289908:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290371:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcd889 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290381:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcd889 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290389:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcd889 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744565.290565:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788744565.290736:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290745:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290751:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290757:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744565.290761:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290768:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290779:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac6424c9100) 00010000:00010000:0.0:1788744565.290782:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744565.290786:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290791:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcd87b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290805:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290811:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290817:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290831:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744565.290834:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290853:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290862:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ac6424c9000) 00010000:00010000:0.0:1788744565.290864:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744565.290867:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.290873:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcd882 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.292019:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcd874 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8ef expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.292041:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782171800/0xb6207a6e76dcd889 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8ef expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.292049:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac6424c9200) 00010000:00010000:0.0:1788744565.292051:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744565.292053:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782171800, rc 0) 00000100:00100000:0.0:1788744565.292120:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15568:x1875634138770176:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2407us (2767us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788744565.292129:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1788744565.298123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.298457:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138770304 00000100:00100000:3.0:1788744565.298469:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138770304 00000100:00100000:3.0:1788744565.298526:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788744565.298537:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15568:x1875634138770304:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788744565.298654:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15568:x1875634138770304:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 118us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.298662:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788744565.309030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.312882:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138770432 00000100:00100000:2.0:1788744565.312899:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138770432 00000100:00100000:3.0:1788744565.316908:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788744565.316924:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:15568:x1875634138770432:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788744565.317753:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788744565.321249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.321600:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138770560 00000100:00100000:3.0:1788744565.321610:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138770560 00000100:00100000:3.0:1788744565.321673:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1788744565.321684:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15574:x1875634138770560:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744565.321717:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744565.321740:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd897 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8f6 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321802:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321818:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321830:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321857:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321865:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321873:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321914:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321922:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321928:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321934:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744565.321943:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321950:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321961:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:3.0:1788744565.321964:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.321969:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321975:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd89e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321990:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.321996:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322001:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322006:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744565.322009:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322014:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322021:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac7557d5600) 00010000:00010000:3.0:1788744565.322023:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.322032:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322038:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd8a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322070:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd897 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8f6 expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322081:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:3.0:1788744565.322083:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.322087:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd897 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8f6 expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.322097:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030200, rc 0) 00000100:00100000:3.0:1788744565.322159:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15574:x1875634138770560:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 477us (920us total) trans 0 rc 301/301 00000100:00100000:3.0:1788744565.322166:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000004:00080000:3.0:1788744565.325770:0:18665:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 8801us 00000100:00100000:1.0:1788744565.329352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.329470:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138770688 00000100:00100000:2.0:1788744565.329480:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138770688 00000100:00100000:2.0:1788744565.329536:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788744565.329546:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15574:x1875634138770688:12345-192.168.203.4@tcp:700:lfs.0 00000100:00100000:2.0:1788744565.329646:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15574:x1875634138770688:12345-192.168.203.4@tcp:700:lfs.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744565.329662:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744565.337903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.337994:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138770944 00000100:00100000:0.0:1788744565.338005:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138770944 00000100:00100000:0.0:1788744565.338071:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:0.0:1788744565.338084:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:15574:x1875634138770944:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1788744565.338145:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744565.338172:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd7c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d863 expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.338192:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:0.0:1788744565.338197:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744565.338260:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.338274:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 5 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.338283:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.338316:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 5 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.338331:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 5 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744565.338345:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154579584:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788744565.338454:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac643562240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744565.341888:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154579584:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788744565.341924:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744565.342730:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.342792:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138771072 00000100:00100000:3.0:1788744565.342801:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138771072 00010000:00010000:3.0:1788744565.342870:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 6 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744565.342911:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1788744565.342921:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:2395:x1875634138771072:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744565.342935:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744565.342942:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 6 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.342964:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 6 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.342989:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd804 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8d3 expref: 6 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.343005:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:3.0:1788744565.343010:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.343019:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.343026:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.343057:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744565.343109:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2395:x1875634138771072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 188us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.343117:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00010000:00010000:1.0:1788744565.343124:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.343135:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.343161:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.343171:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.343180:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788744565.343312:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744565.344498:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344528:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344538:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744565.344556:0:17138:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a184428a reply state 0000000045bc4772 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344567:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344574:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:1.0:1788744565.344577:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744565.344581:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788744565.344587:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788744565.344594:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344601:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344607:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344612:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744565.344616:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344626:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344712:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac64354cd00) 00010000:00010000:1.0:1788744565.344714:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744565.344718:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344724:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd8ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744565.344742:0:17138:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a184428a reply state 0000000045bc4772 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344750:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.344757:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac64354c000) 00010000:00010000:1.0:1788744565.344759:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744565.344761:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788744565.344832:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+10:15574:x1875634138770944:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 6749us (6938us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788744565.344849:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1788744565.360724:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:15568:x1875634138770432:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 43792us (51690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.360738:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1788744565.420050:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.420152:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138771200 00000100:00100000:0.0:1788744565.420162:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138771200 00000100:00100000:0.0:1788744565.420256:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788744565.420267:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+10:15582:x1875634138771200:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:0.0:1788744565.420290:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744565.420313:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd8c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d8fd expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.420376:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170400/0xb6207a6e76dcd8c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.420391:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170400/0xb6207a6e76dcd8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.420437:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170400/0xb6207a6e76dcd8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744565.420483:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788744565.420487:0:17137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744565.420522:0:17137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170400/0xb6207a6e76dcd8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.420549:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd8c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8fd expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.420569:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170400/0xb6207a6e76dcd8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d8fd expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.420594:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:0.0:1788744565.420597:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744565.420601:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170400, rc 0) 00000100:00100000:0.0:1788744565.420662:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+11:15582:x1875634138771200:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 396us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744565.422067:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000040:00080000:3.0:1788744565.427960:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744565.439620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.439945:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138771328 00000100:00100000:1.0:1788744565.439957:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138771328 00000100:00100000:1.0:1788744565.440025:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788744565.440038:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:15583:x1875634138771328:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744565.440063:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744565.440085:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd8cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d904 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.440152:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd8d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.440179:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.440191:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744565.440236:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744565.440239:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744565.440259:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.440283:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd8cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d904 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.440300:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47800/0xb6207a6e76dcd8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d904 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.440308:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:1.0:1788744565.440311:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744565.440314:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47800, rc 0) 00000100:00100000:1.0:1788744565.440764:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15583:x1875634138771328:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 728us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.440773:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1788744565.443396:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.443769:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138771456 00000100:00100000:1.0:1788744565.443780:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138771456 00000100:00100000:1.0:1788744565.443890:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788744565.443901:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+6:15583:x1875634138771456:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744565.443922:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744565.443956:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd8dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d90b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444017:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444031:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444041:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444052:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444059:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444065:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444133:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcd8f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444142:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcd8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444150:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcd8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744565.444190:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744565.444194:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744565.444213:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcd8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444234:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444241:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444248:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444255:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744565.444260:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444268:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444280:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:1.0:1788744565.444283:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744565.444288:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444295:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd8e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444307:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444314:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444319:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444330:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744565.444334:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444340:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444349:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac64354c000) 00010000:00010000:1.0:1788744565.444352:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744565.444355:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444361:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd8eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444388:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd8dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d90b expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444550:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcd8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d90b expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.444558:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:1.0:1788744565.444560:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744565.444562:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47000, rc 0) 00000100:00100000:1.0:1788744565.444623:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+7:15583:x1875634138771456:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 725us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.444631:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1788744565.447346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.447443:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138771584 00000100:00100000:3.0:1788744565.447454:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138771584 00000100:00100000:3.0:1788744565.447527:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788744565.447536:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:15583:x1875634138771584:12345-192.168.203.4@tcp:900:lfs.0 00000100:00100000:3.0:1788744565.447629:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:15583:x1875634138771584:12345-192.168.203.4@tcp:900:lfs.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.447637:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00080000:2.0:1788744565.447732:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744565.453716:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.453834:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138771840 00000100:00100000:3.0:1788744565.453855:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138771840 00000100:00100000:3.0:1788744565.453914:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:3.0:1788744565.453926:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+7:15583:x1875634138771840:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744565.453951:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744565.453972:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd8f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d912 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744565.454080:0:18665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788744565.454188:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd8f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d912 expref: 9 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.454201:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:3.0:1788744565.454205:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744565.454210:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd8f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d912 expref: 9 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.454225:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030200, rc 0) 00000100:00100000:3.0:1788744565.454290:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+8:15583:x1875634138771840:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 366us (587us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788744565.454298:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788744565.457957:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.458052:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138772096 00000100:00100000:0.0:1788744565.458062:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138772096 00000100:00100000:0.0:1788744565.458120:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788744565.458131:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+8:15583:x1875634138772096:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1788744565.458188:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744565.458215:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcd8f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d90b expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.458231:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:0.0:1788744565.458236:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744565.458257:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.458271:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.458281:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744565.458532:0:17137:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c1d2b533 reply state 0000000076d87e44 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.458570:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.458580:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:0.0:1788744565.458582:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788744565.458585:0:17137:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788744565.458594:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788744565.458795:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+9:15583:x1875634138772096:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 665us (846us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788744565.458803:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788744565.461540:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.462016:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138772352 00000100:00100000:3.0:1788744565.462027:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138772352 00000100:00100000:3.0:1788744565.462076:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788744565.462103:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+9:15583:x1875634138772352:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788744565.462349:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+10:15583:x1875634138772352:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 247us (815us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788744565.462357:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788744565.465793:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.466104:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138772608 00000100:00100000:3.0:1788744565.466115:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138772608 00000100:00100000:3.0:1788744565.466187:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1788744565.466199:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+10:15583:x1875634138772608:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788744565.466222:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744565.466244:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd90e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d919 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466318:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466333:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466344:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466354:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466361:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466367:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744565.466542:0:18665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788744565.466618:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466627:0:18665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466634:0:18665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466653:0:18665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744565.466657:0:18665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466665:0:18665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466677:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:3.0:1788744565.466680:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.466685:0:18665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466691:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466704:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466709:0:18665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466725:0:18665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466730:0:18665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744565.466733:0:18665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466739:0:18665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466747:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac64354c000) 00010000:00010000:3.0:1788744565.466749:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.466752:0:18665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466757:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd91c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466792:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd90e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d919 expref: 12 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466802:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:3.0:1788744565.466804:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744565.466808:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd90e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d919 expref: 12 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.466817:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031200, rc 0) 00000100:00100000:3.0:1788744565.466880:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+11:15583:x1875634138772608:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 683us (1098us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788744565.466895:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:0.0:1788744565.472087:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.472177:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138772736 00000100:00100000:1.0:1788744565.472202:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138772736 00000100:00100000:1.0:1788744565.472261:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:1.0:1788744565.472272:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+11:15583:x1875634138772736:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744565.472293:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744565.472312:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd92a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d920 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.472449:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.472462:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.472473:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744565.472499:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788744565.472502:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788744565.472521:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.472547:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd92a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.472563:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.472571:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:1.0:1788744565.472573:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744565.472577:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47600, rc 0) 00000100:00100000:1.0:1788744565.472633:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+12:15583:x1875634138772736:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 364us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.472641:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1788744565.476669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.476753:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138772864 00000100:00100000:3.0:1788744565.476765:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138772864 00000100:00100000:3.0:1788744565.476820:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788744565.476831:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+12:15583:x1875634138772864:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:3.0:1788744565.481783:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+12:15583:x1875634138772864:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 4944us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.481798:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1788744565.485085:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.485160:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138773120 00000100:00100000:1.0:1788744565.485171:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138773120 00000100:00100000:1.0:1788744565.485228:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788744565.485239:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+12:15583:x1875634138773120:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788744565.485499:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74502b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+13:15583:x1875634138773120:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 262us (422us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788744565.485507:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000040:00080000:3.0:1788744565.487164:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744565.532685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.532817:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138773248 00000100:00100000:3.0:1788744565.532827:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138773248 00000100:00100000:3.0:1788744565.532893:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1788744565.532904:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+11:15589:x1875634138773248:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788744565.532925:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744565.532945:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d927 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533011:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533026:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533038:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533049:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533072:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533079:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533152:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd94d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533160:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533167:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744565.533201:0:18665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788744565.533204:0:18665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788744565.533244:0:18665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533257:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533264:0:18665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533271:0:18665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533278:0:18665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740030000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744565.533281:0:18665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533295:0:18665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533308:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:3.0:1788744565.533311:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.533317:0:18665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533322:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533336:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533342:0:18665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533348:0:18665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533353:0:18665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac740031c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:3.0:1788744565.533355:0:18665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533360:0:18665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533367:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac64354c000) 00010000:00010000:3.0:1788744565.533369:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744565.533373:0:18665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533387:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533471:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d927 expref: 13 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533485:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030200/0xb6207a6e76dcd94d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d927 expref: 12 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.533492:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:3.0:1788744565.533494:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788744565.533497:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030200, rc 0) 00000100:00100000:3.0:1788744565.533550:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+12:15589:x1875634138773248:12345-192.168.203.4@tcp:101:bash.0 Request processed in 648us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.533558:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1788744565.536449:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.536794:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138773376 00000100:00100000:0.0:1788744565.536806:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138773376 00000100:00100000:0.0:1788744565.536867:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788744565.536876:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:15589:x1875634138773376:12345-192.168.203.4@tcp:900:bash.0 00000100:00100000:0.0:1788744565.536946:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:15589:x1875634138773376:12345-192.168.203.4@tcp:900:bash.0 Request processed in 71us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744565.536953:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788744565.539395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.540097:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138773632 00000100:00100000:1.0:1788744565.540107:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138773632 00000100:00100000:1.0:1788744565.540206:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1788744565.540217:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+12:15589:x1875634138773632:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788744565.540240:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744565.540264:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd954 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d92e expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.540367:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.540382:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.540391:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.540474:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.540502:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 12 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744565.540517:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875634154579712:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744565.540601:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75068a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744565.543885:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.543967:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138773760 00000100:00100000:3.0:1788744565.543978:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138773760 00010000:00010000:3.0:1788744565.544023:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 13 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744565.544070:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788744565.544081:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+13:2394:x1875634138773760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744565.544095:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744565.544102:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 13 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.544132:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 13 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.544156:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:3.0:1788744565.544160:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.544170:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.544177:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.544196:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744565.544255:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+13:2394:x1875634138773760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.544262:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00010000:00010000:1.0:1788744565.544458:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd931 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d920 expref: 12 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744565.544476:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac6435f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875634154579712:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744565.544495:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.544504:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.544511:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.544535:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.544546:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.544553:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545091:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545110:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545118:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744565.545130:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744565.545157:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545164:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545170:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545176:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744565.545180:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545186:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545196:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:1.0:1788744565.545199:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744565.545203:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545209:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd95b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744565.545219:0:17139:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000fa1a71c6 reply state 0000000011e6cd92 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545236:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545242:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ac64354cd00) 00010000:00010000:1.0:1788744565.545244:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788744565.545247:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788744565.545281:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd954 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 15 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545294:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 14 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.545302:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744565.545304:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788744565.545307:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46800, rc 0) 00000100:00100000:1.0:1788744565.545346:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+15:15589:x1875634138773632:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5131us (5960us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788744565.545354:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1788744565.556630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744565.556920:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138773888 00000100:00100000:0.0:1788744565.556931:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138773888 00000100:00100000:0.0:1788744565.556994:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788744565.557005:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+15:15589:x1875634138773888:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788744565.557031:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744565.557052:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd977 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d935 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557131:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557146:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557159:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744565.557212:0:18665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788744565.557217:0:18665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744565.557241:0:18665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557253:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557278:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd977 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 17 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557295:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 16 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744565.557303:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:0.0:1788744565.557306:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744565.557310:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac782170200, rc 0) 00000100:00100000:0.0:1788744565.557516:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+16:15589:x1875634138773888:12345-192.168.203.4@tcp:101:bash.0 Request processed in 512us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744565.557524:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788744565.560793:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.560889:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138774144 00000100:00100000:1.0:1788744565.560901:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138774144 00000100:00100000:1.0:1788744565.560964:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788744565.560975:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+16:15589:x1875634138774144:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788744565.561290:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+17:15589:x1875634138774144:12345-192.168.203.4@tcp:35:bash.0 Request processed in 315us (504us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788744565.561314:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788744565.614903:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154579968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744565.614981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744565.615018:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744565.615035:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154579840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744565.615073:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744565.615094:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744565.615103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac74394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154580096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744565.615122:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154579968 00000100:00100000:2.0:1788744565.615131:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154579968 00000100:00100000:3.0:1788744565.615135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744565.615179:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154579840 00000100:00100000:2.0:1788744565.615183:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154579840 00000100:00100000:3.0:1788744565.615200:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744565.615212:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154579968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744565.615252:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788744565.615295:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154579968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.615750:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580096 00000100:00100000:1.0:1788744565.615762:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580096 00000100:00100000:1.0:1788744565.615895:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744565.615904:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154580096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788744565.615926:0:18646:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788744565.615966:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875634154580096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.615972:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788744565.616006:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744565.616048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154580096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744565.616063:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875634154579968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744565.624632:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744565.624673:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154579840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788744565.624714:0:17878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788744565.624804:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154579840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (9729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744565.624812:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788744565.624975:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac74394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154579840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744565.626963:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744565.669944:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.670063:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138774400 00000100:00100000:1.0:1788744565.670073:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138774400 00000100:00100000:1.0:1788744565.670140:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788744565.670152:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+17:15599:x1875634138774400:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744565.670178:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744565.670208:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d93c expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744565.670315:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788744565.670446:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd985 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d93c expref: 19 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.670461:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac6424c9000) 00010000:00010000:1.0:1788744565.670464:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744565.670469:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d93c expref: 19 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.670498:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46a00, rc 0) 00000100:00100000:1.0:1788744565.670569:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+18:15599:x1875634138774400:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 418us (636us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788744565.670578:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788744565.680990:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.684727:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138774656 00000100:00100000:1.0:1788744565.684744:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138774656 00000100:00100000:1.0:1788744565.684831:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788744565.684851:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+18:15599:x1875634138774656:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788744565.685213:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+19:15599:x1875634138774656:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 363us (4233us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788744565.685222:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788744565.741020:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.741130:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138774912 00000100:00100000:1.0:1788744565.741143:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138774912 00000100:00100000:1.0:1788744565.741206:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1788744565.741217:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+19:15602:x1875634138774912:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788744565.741244:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744565.741265:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd993 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d943 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.741380:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd99a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.741395:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd99a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.741457:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd99a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744565.741487:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744565.741593:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd993 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d943 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.741611:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd99a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d943 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.741619:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744565.741622:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744565.741625:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46e00, rc 0) 00000100:00100000:1.0:1788744565.741676:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+21:15602:x1875634138774912:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 461us (666us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788744565.741683:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1788744565.749696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.749735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.750225:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775168 00000100:00100000:3.0:1788744565.750236:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775168 00000100:00100000:3.0:1788744565.750310:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1788744565.750321:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+21:2394:x1875634138775168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744565.750339:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744565.750363:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcd99a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d943 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744565.750382:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:3.0:1788744565.750388:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744565.750484:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+20:2394:x1875634138775168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 164us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.750491:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744565.751910:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775040 00000100:00100000:1.0:1788744565.751923:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775040 00000100:00100000:1.0:1788744565.751987:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1788744565.752000:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+20:15602:x1875634138775040:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1788744565.752062:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752079:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752090:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752125:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752145:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752152:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752158:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744565.752163:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752170:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752181:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744565.752184:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744565.752188:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744565.752194:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcd9a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744565.752269:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+20:15602:x1875634138775040:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 272us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.752277:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1788744565.756013:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744565.756097:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775424 00000100:00100000:3.0:1788744565.756107:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775424 00000100:00100000:3.0:1788744565.756160:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788744565.756171:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+20:15602:x1875634138775424:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788744565.756430:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+21:15602:x1875634138775424:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 231us (397us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788744565.756439:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788744565.770690:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.770739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.770770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.770799:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744565.770819:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744565.770893:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775808 00000100:00100000:1.0:1788744565.770907:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775808 00000100:00100000:0.0:1788744565.770907:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775552 00000100:00100000:0.0:1788744565.770914:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775552 00000100:00100000:0.0:1788744565.770965:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:1.0:1788744565.770971:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138776064 00000100:00100000:1.0:1788744565.770975:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138776064 00000100:00100000:0.0:1788744565.770978:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:2397:x1875634138775552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744565.770994:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775680 00000100:00100000:1.0:1788744565.770998:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775680 00000100:00100000:1.0:1788744565.771032:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138775936 00000100:00100000:1.0:1788744565.771035:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138775936 00000100:00100000:0.0:1788744565.771052:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97a800c0-99ca-4eb0-8258-5e8a18a17066+13:2397:x1875634138775552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.771056:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788744565.771067:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:1.0:1788744565.771070:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138775808:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788744565.771114:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138775808:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744565.771122:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788744565.771137:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138776064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788744565.771165:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138776064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00080000:2.0:1788744565.771245:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744565.771249:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744565.774540:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1788744565.774664:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788744565.774684:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138775680:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744565.774824:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788744565.774846:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138775936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788744565.774879:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdc352e8-3c6b-4f1a-950a-ac93337c2f7b+5:2397:x1875634138775936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744565.774887:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788744565.774935:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2397:x1875634138775680:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 109us (3982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744565.774943:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788744565.776292:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00010000:00010000:2.0:1788744565.935571:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744566.100676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.101044:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138776320 00000100:00100000:1.0:1788744566.101055:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138776320 00000100:00100000:1.0:1788744566.101122:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788744566.101133:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+21:15634:x1875634138776320:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1788744566.101157:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744566.101175:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd9af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d94a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.101279:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcd9b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.101294:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcd9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.101916:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcd9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744566.101947:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744566.102067:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcd9af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d94a expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.102085:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcd9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d94a expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.102094:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.102096:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744566.102100:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47400, rc 0) 00000100:00100000:1.0:1788744566.102929:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:15634:x1875634138776320:12345-192.168.203.4@tcp:101:cat.0 Request processed in 1794us (2258us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788744566.102938:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788744566.114519:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.115147:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138776448 00000100:00100000:2.0:1788744566.115158:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138776448 00000100:00100000:2.0:1788744566.115229:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788744566.115253:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:2395:x1875634138776448:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744566.115269:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744566.115295:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcd9b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d94a expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.115315:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:2.0:1788744566.115320:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744566.115375:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+22:2395:x1875634138776448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 125us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.115383:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788744566.118875:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.119176:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138776704 00000100:00100000:2.0:1788744566.119187:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138776704 00000100:00100000:2.0:1788744566.119245:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788744566.119255:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6424c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+22:15634:x1875634138776704:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:2.0:1788744566.119568:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6424c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:15634:x1875634138776704:12345-192.168.203.4@tcp:35:cat.0 Request processed in 313us (702us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788744566.119576:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788744566.126744:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac743948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154580352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744566.126824:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.126876:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744566.126882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77faaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154580224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744566.126933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.126966:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580352 00000100:00100000:3.0:1788744566.126973:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580352 00000100:00100000:3.0:1788744566.127027:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580224 00000100:00100000:3.0:1788744566.127031:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580224 00000100:00100000:3.0:1788744566.127047:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744566.127055:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154580352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744566.127075:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788744566.127117:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875634154580352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.127124:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744566.127139:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744566.127145:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74394a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154580224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788744566.127163:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788744566.127188:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74394a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875634154580224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.127194:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788744566.127209:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744566.127213:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744566.127242:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77faaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875634154580224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788744566.127254:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac743948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875634154580352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744566.128393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154580736:0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.128460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744566.128484:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154581248:0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.128507:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744566.128529:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788744566.128535:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154580864:0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.128556:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744566.128569:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154581376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.128586:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744566.128614:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154581248 00000100:00100000:0.0:1788744566.128620:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154581248 00000100:00100000:0.0:1788744566.128674:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580864 00000100:00100000:0.0:1788744566.128678:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580864 00000100:00100000:0.0:1788744566.128689:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154581376 00000100:00100000:0.0:1788744566.128691:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154581376 00000100:00100000:0.0:1788744566.128704:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744566.128711:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154581248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.128891:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875634154581248:12345-0@lo:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.128900:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744566.128918:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744566.128924:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154580864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.128954:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875634154580864:12345-0@lo:400:kworker.0 Request processed in 31us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.128964:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744566.128977:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744566.128982:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154581376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.129082:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875634154581376:12345-0@lo:400:kworker.0 Request processed in 99us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.129088:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744566.129122:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875634154580864:0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.129134:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875634154581376:0@lo:400:kworker.0 00010000:00080000:0.0:1788744566.129146:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac644546680 x1875634154581248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744566.129157:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875634154581248:0@lo:400:kworker.0 00000100:00080000:3.0:1788744566.129287:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744566.129291:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744566.129304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac641b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154580480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744566.129333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.129364:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154580992:0@lo:400:kworker.0 00000100:00100000:3.0:1788744566.129431:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.129452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154581504:0@lo:400:kworker.0 00000100:00100000:3.0:1788744566.129473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.129492:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788744566.129498:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154580608:0@lo:400:kworker.0 00000100:00100000:3.0:1788744566.129523:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.129549:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac644544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154581120:0@lo:400:kworker.0 00000100:00100000:3.0:1788744566.129569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744566.129595:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580608 00000100:00100000:3.0:1788744566.129600:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580608 00000100:00100000:3.0:1788744566.129630:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788744566.129636:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77491f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+24:3643:x1875634154580608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744566.129670:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77491f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3734829d-853b-494e-83d0-e0bd2808e668+24:3643:x1875634154580608:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.129677:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788744566.129711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3734829d-853b-494e-83d0-e0bd2808e668:3643:1875634154580608:0@lo:400:kworker.0 00000100:00100000:1.0:1788744566.129936:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580992 00000100:00100000:1.0:1788744566.129941:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580992 00000100:00100000:1.0:1788744566.129960:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154581504 00000100:00100000:1.0:1788744566.129963:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154581504 00000100:00100000:1.0:1788744566.129982:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154581120 00000100:00100000:1.0:1788744566.129985:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154581120 00000100:00100000:1.0:1788744566.130012:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788744566.130019:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154580992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744566.130107:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580736 00000100:00100000:2.0:1788744566.130112:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580736 00000100:00100000:2.0:1788744566.130146:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744566.130155:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154580736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744566.130193:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875634154580736:12345-0@lo:400:kworker.0 Request processed in 41us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.130199:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744566.130317:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744566.130326:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154581504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.130398:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154580480 00000100:00100000:0.0:1788744566.130429:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154580480 00000100:00100000:0.0:1788744566.130461:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744566.130468:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac743948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154580480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744566.130482:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788744566.130620:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875634154580992:12345-0@lo:400:kworker.0 Request processed in 601us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.130627:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788744566.130642:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744566.130655:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154581120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744566.135192:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875634154581504:12345-0@lo:400:kworker.0 Request processed in 4858us (5707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.135208:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788744566.135285:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744566.135290:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744566.135292:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744566.135453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875634154580736:0@lo:400:kworker.0 00000100:00100000:0.0:1788744566.135910:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac743948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875634154580480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5440us (6572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.135920:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744566.137126:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875634154581120:12345-0@lo:400:kworker.0 Request processed in 6464us (7547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.137141:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788744566.137885:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875634154581120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744566.137920:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac641b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875634154580480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744566.137952:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875634154580992:0@lo:400:kworker.0 00010000:00080000:2.0:1788744566.137968:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ac644547800 x1875634154581504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744566.137978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac644547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875634154581504:0@lo:400:kworker.0 00000100:00100000:1.0:1788744566.194816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.194913:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138776960 00000100:00100000:3.0:1788744566.194924:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138776960 00000100:00100000:3.0:1788744566.194992:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788744566.195001:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:15640:x1875634138776960:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1788744566.195026:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744566.195044:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd9c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d951 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195144:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195158:0:18665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195166:0:18665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 24 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195173:0:18665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195206:0:18665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 24 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195219:0:18665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 24 pid: 18665 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744566.195232:0:18665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac780fd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18665:1875634154581632:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744566.195372:0:18665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.195393:0:18665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744566.195440:0:18665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac780fd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18665:1875634154581760:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744566.195468:0:18665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac7432e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744566.198151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.198240:0:18665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac780fd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18665:1875634154581632:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744566.198252:0:18665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac780fd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18665:1875634154581760:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744566.198275:0:18665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.198516:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138777088 00000100:00100000:1.0:1788744566.198523:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138777088 00010000:00010000:1.0:1788744566.198558:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 25 pid: 18665 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.198599:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1788744566.198608:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+25:2394:x1875634138777088:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744566.198620:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744566.198626:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 25 pid: 18665 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.198647:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 25 pid: 18665 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.198668:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd97e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d935 expref: 25 pid: 18665 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.198684:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.198687:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.198696:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.198712:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744566.198767:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+24:2394:x1875634138777088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 159us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.198774:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788744566.200273:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.200625:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138777216 00000100:00100000:1.0:1788744566.200646:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138777216 00010000:00010000:1.0:1788744566.200681:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.200720:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788744566.200733:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac746834050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+24:2394:x1875634138777216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744566.200746:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744566.200752:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.200765:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.200783:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46800/0xb6207a6e76dcd969 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d92e expref: 24 pid: 17139 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.200798:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.200802:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.200811:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.200843:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.200876:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744566.200927:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac746834050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:2394:x1875634138777216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 198us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.200935:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00010000:00010000:3.0:1788744566.201326:0:18665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.201335:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744566.201357:0:18665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788744566.201547:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031c00/0xb6207a6e76dcd9c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d951 expref: 24 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.201564:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031200/0xb6207a6e76dcd9cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d951 expref: 23 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.201571:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:3.0:1788744566.201574:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744566.201584:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031200, rc 0) 00000100:00100000:3.0:1788744566.201622:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:15640:x1875634138776960:12345-192.168.203.4@tcp:101:dd.0 Request processed in 6623us (6815us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788744566.201639:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:2.0:1788744566.205388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.205729:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138777344 00000100:00100000:3.0:1788744566.205739:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138777344 00000100:00100000:3.0:1788744566.205819:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1788744566.205828:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+23:15640:x1875634138777344:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1788744566.205861:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744566.205879:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d958 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.205914:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.205929:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.205940:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.206051:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 25 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.206070:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.206078:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:3.0:1788744566.206082:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744566.206092:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031400, rc 0) 00000100:00100000:3.0:1788744566.206157:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+24:15640:x1875634138777344:12345-192.168.203.4@tcp:101:dd.0 Request processed in 330us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.206164:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788744566.211669:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.211741:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138777600 00000100:00100000:0.0:1788744566.211752:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138777600 00000100:00100000:0.0:1788744566.211804:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:0.0:1788744566.211814:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac641b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+24:15640:x1875634138777600:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1788744566.212057:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.212077:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.212090:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744566.212137:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788744566.212160:0:17139:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000065c39e65 reply state 0000000061d28299 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.212174:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.212182:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:0.0:1788744566.212185:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744566.212204:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744566.212310:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac641b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+27:15640:x1875634138777600:12345-192.168.203.4@tcp:36:dd.0 Request processed in 495us (649us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788744566.212317:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000020:00080000:0.0:1788744566.212323:0:17139:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788744566.215132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.215211:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138777728 00000100:00100000:2.0:1788744566.215222:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138777728 00000100:00100000:2.0:1788744566.215279:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:2.0:1788744566.215288:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+27:15640:x1875634138777728:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1788744566.215310:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744566.215331:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd9ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d95f expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.215385:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd9ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d95f expref: 28 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.215446:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd9ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d95f expref: 28 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.215465:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:2.0:1788744566.215468:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744566.215472:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b58e00, rc 0) 00000100:00100000:2.0:1788744566.215868:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15640:x1875634138777728:12345-192.168.203.4@tcp:101:dd.0 Request processed in 578us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.215875:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:0.0:1788744566.230811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.230911:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138777984 00000100:00100000:2.0:1788744566.230936:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138777984 00000100:00100000:2.0:1788744566.231003:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788744566.231014:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15640:x1875634138777984:12345-192.168.203.4@tcp:103:dd.0 00010000:00010000:2.0:1788744566.231029:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744566.231052:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcd9ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d95f expref: 28 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.231070:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:2.0:1788744566.231076:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744566.231134:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+27:15640:x1875634138777984:12345-192.168.203.4@tcp:103:dd.0 Request processed in 122us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.231142:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788744566.233332:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.233766:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138778112 00000100:00100000:0.0:1788744566.233777:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138778112 00000100:00100000:0.0:1788744566.233880:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1788744566.233891:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+27:15640:x1875634138778112:12345-192.168.203.4@tcp:58:dd.0 00010000:00010000:0.0:1788744566.234009:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.234027:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.234038:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744566.235928:0:17139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744566.236223:0:17139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788744566.236346:0:17139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788744566.238336:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+27:15640:x1875634138778112:12345-192.168.203.4@tcp:58:dd.0 Request processed in 2746us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.238351:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1788744566.238864:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.239081:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138778240 00000100:00100000:3.0:1788744566.239091:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138778240 00000100:00100000:3.0:1788744566.239143:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:3.0:1788744566.239152:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+27:15640:x1875634138778240:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1788744566.239172:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744566.239191:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d966 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.239241:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.239251:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 28 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.239271:0:17138:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.239284:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 28 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.239296:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:3.0:1788744566.239299:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744566.239303:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 28 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.239329:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030000, rc 0) 00000100:00100000:3.0:1788744566.239385:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15640:x1875634138778240:12345-192.168.203.4@tcp:101:dd.0 Request processed in 233us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.240431:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000040:00080000:3.0:1788744566.448669:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788744566.511326:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788744566.511336:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744566.511366:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788744566.511375:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788744566.511539:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac780fd3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1875634154581888:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744566.511629:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac753225a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744566.529569:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.529733:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac780fd3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1875634154581888:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744566.531016:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138778368 00000100:00100000:0.0:1788744566.531029:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138778368 00000100:00100000:0.0:1788744566.531098:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788744566.531109:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15641:x1875634138778368:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744566.531161:0:18665:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744566.531289:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15641:x1875634138778368:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 181us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.531297:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:2.0:1788744566.542051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.542164:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138778496 00000100:00100000:0.0:1788744566.542175:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138778496 00000100:00100000:0.0:1788744566.542250:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1788744566.542262:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15641:x1875634138778496:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788744566.542347:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542368:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542386:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542512:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542522:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542530:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542556:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542565:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542587:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744566.542643:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788744566.542648:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744566.542666:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542677:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542684:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542691:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542696:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170c00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.542700:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542708:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542719:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac6424c9200) 00010000:00010000:0.0:1788744566.542723:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.542728:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542733:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170c00/0xb6207a6e76dcda03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542758:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542764:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542770:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542775:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dac400 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.542778:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542783:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542791:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ac6424c9800) 00010000:00010000:0.0:1788744566.542793:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.542795:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542800:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542816:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542821:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542826:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542849:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac643dad600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.542853:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542859:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542867:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:0.0:1788744566.542870:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.542872:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.542877:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744566.542947:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15641:x1875634138778496:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 685us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.542956:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788744566.553041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.554349:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138778752 00000100:00100000:0.0:1788744566.554364:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138778752 00000100:00100000:1.0:1788744566.554782:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1788744566.554795:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+28:15641:x1875634138778752:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744566.554818:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744566.554856:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcda18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d96d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555144:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555160:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555172:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744566.555184:0:18665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744566.555268:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555287:0:18665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555293:0:18665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555299:0:18665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47600 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744566.555303:0:18665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555310:0:18665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555322:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.555325:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788744566.555330:0:18665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555336:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47600/0xb6207a6e76dcda1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555380:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcda18 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d96d expref: 30 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555391:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac6424c9200) 00010000:00010000:1.0:1788744566.555393:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744566.555397:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47400/0xb6207a6e76dcda18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d96d expref: 30 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.555822:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47400, rc 0) 00000100:00100000:1.0:1788744566.556057:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6431eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+29:15641:x1875634138778752:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1263us (3021us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788744566.556065:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1788744566.561318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.563166:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138778880 00000100:00100000:0.0:1788744566.563179:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138778880 00000100:00100000:2.0:1788744566.563338:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1788744566.563349:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+29:15641:x1875634138778880:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744566.563385:0:17138:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744566.563541:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+29:15641:x1875634138778880:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 193us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.563549:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788744566.567218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.567314:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138779136 00000100:00100000:2.0:1788744566.567324:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138779136 00000100:00100000:2.0:1788744566.567380:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1788744566.567390:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+29:15641:x1875634138779136:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744566.567467:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744566.567488:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcda2d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d974 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744566.568119:0:17137:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1788744566.568128:0:17137:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788744566.568151:0:17137:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788744566.568324:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcda34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.568339:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcda34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.568351:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcda34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.568437:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59e00/0xb6207a6e76dcda2d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d974 expref: 32 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.568454:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcda34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d974 expref: 31 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.568462:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac7604c8000) 00010000:00010000:2.0:1788744566.568464:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744566.568468:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac774b59a00, rc 0) 00000100:00100000:2.0:1788744566.568535:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+31:15641:x1875634138779136:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1327us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788744566.568542:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:1.0:1788744566.572576:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.572889:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138779392 00000100:00100000:2.0:1788744566.572912:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138779392 00000100:00100000:2.0:1788744566.572971:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1788744566.572980:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+31:15641:x1875634138779392:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744566.573032:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744566.573056:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59a00/0xb6207a6e76dcda34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d974 expref: 31 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573079:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac7604c8000) 00010000:00010000:2.0:1788744566.573090:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744566.573113:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573126:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573136:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573188:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573196:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573203:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573247:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573254:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573267:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573273:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b59000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744566.573277:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573284:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573291:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:2.0:1788744566.573294:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744566.573297:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573303:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b59000/0xb6207a6e76dcda42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573313:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573319:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573325:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573329:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744566.573332:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573347:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573355:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x787bad64 (ffff9ac7604c8c00) 00010000:00010000:2.0:1788744566.573357:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744566.573359:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.573365:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda49 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x787bad64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744566.573485:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac6435f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+30:15641:x1875634138779392:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 504us (917us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744566.573493:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1788744566.578055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.578137:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138779520 00000100:00100000:1.0:1788744566.578147:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138779520 00000100:00100000:1.0:1788744566.578210:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788744566.578221:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+30:15641:x1875634138779520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744566.578243:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744566.578264:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcda50 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d97b expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.578297:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcda57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.578310:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcda57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.578321:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcda57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.578878:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46a00/0xb6207a6e76dcda50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d97b expref: 32 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.578899:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46e00/0xb6207a6e76dcda57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d97b expref: 31 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.578907:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:1.0:1788744566.578910:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744566.578921:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f46e00, rc 0) 00000100:00100000:1.0:1788744566.579079:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+31:15641:x1875634138779520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 858us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.579087:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788744566.587600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.587895:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138779776 00000100:00100000:2.0:1788744566.587962:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138779776 00000100:00100000:2.0:1788744566.588061:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1788744566.588072:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+31:15641:x1875634138779776:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744566.588149:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.588166:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.588179:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744566.588341:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788744566.588364:0:17138:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 548269961811ns, next at 549269959818ns, rc = 0 00000004:00010000:2.0:1788744566.588461:0:17138:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000092e90a10 reply state 000000007feb9c39 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.588474:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.588482:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:2.0:1788744566.588486:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788744566.588489:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744566.588795:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+33:15641:x1875634138779776:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 723us (1202us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788744566.588804:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1788744566.590812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.591317:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138779904 00000100:00100000:0.0:1788744566.591328:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138779904 00000100:00100000:0.0:1788744566.591533:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:0.0:1788744566.591546:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+33:15641:x1875634138779904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744566.591567:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744566.591586:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d982 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.591666:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 34 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.591681:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 34 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.591699:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:0.0:1788744566.591703:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744566.591707:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dac000, rc 0) 00000100:00100000:0.0:1788744566.591761:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+34:15641:x1875634138779904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 218us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.594796:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1788744566.595782:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.595898:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138780032 00000100:00100000:1.0:1788744566.595911:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138780032 00000100:00100000:1.0:1788744566.596018:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788744566.596030:0:18642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2394:x1875634138780032:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788744566.596280:0:18642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2394:x1875634138780032:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 251us (501us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788744566.596288:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788744566.599342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.599599:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138780288 00000100:00100000:2.0:1788744566.599610:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138780288 00000100:00100000:2.0:1788744566.599685:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788744566.599697:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac643f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+34:15641:x1875634138780288:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744566.600113:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac643f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+35:15641:x1875634138780288:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 416us (778us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788744566.600122:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788744566.604245:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.604353:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138780544 00000100:00100000:1.0:1788744566.604374:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138780544 00000100:00100000:1.0:1788744566.604678:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1788744566.604692:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+35:15641:x1875634138780544:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744566.604812:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+35:15641:x1875634138780544:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 124us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.609146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.609250:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138780672 00000100:00100000:0.0:1788744566.609260:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138780672 00000100:00100000:0.0:1788744566.609320:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1788744566.609331:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+36:15641:x1875634138780672:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744566.609352:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744566.609376:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d989 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.609537:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.609552:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.609564:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744566.609617:0:17137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788744566.609892:0:17137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.609922:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac400/0xb6207a6e76dcda6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d989 expref: 38 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.609941:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d989 expref: 37 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.609951:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:0.0:1788744566.609954:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788744566.609957:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac643dad600, rc 0) 00000100:00100000:0.0:1788744566.610011:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+37:15641:x1875634138780672:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 681us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.610020:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:2.0:1788744566.614302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.614731:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138780800 00000100:00100000:3.0:1788744566.614742:0:19540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138780800 00000100:00100000:3.0:1788744566.614788:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1788744566.614797:0:19540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2395:x1875634138780800:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744566.614814:0:19540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744566.614843:0:19540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d990 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744566.614867:0:19540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1377, blocks: 0x0 00010000:00010000:3.0:1788744566.614886:0:19540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1788744566.614892:0:19540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744566.614902:0:19540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 7 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.614934:0:19540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 7 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.614948:0:19540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740031c00, rc 0) 00000100:00100000:3.0:1788744566.615008:0:19540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2395:x1875634138780800:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 211us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.615015:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788744566.615708:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788744566.619583:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.619755:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781056 00000100:00100000:3.0:1788744566.619764:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781056 00000100:00100000:3.0:1788744566.619826:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1788744566.619846:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77faaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+36:15641:x1875634138781056:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744566.619949:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77faaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+36:15641:x1875634138781056:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 105us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.619957:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1788744566.624993:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.625160:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781184 00000100:00100000:3.0:1788744566.625169:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781184 00000100:00100000:3.0:1788744566.625231:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1788744566.625241:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+36:15641:x1875634138781184:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788744566.634929:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788744566.634945:0:17117:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788744566.634986:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788744566.635147:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+19:15641:x1875634138781184:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 9902us (10158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.635158:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00010000:00010000:2.0:1788744566.635304:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.635316:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.635332:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.635338:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170a00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:2.0:1788744566.635342:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.635349:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.635373:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:2.0:1788744566.635376:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788744566.635387:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.635398:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcd907 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744566.637157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154582016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788744566.637240:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744566.638308:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154582016 00000100:00100000:1.0:1788744566.638319:0:19228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154582016 00000100:00100000:1.0:1788744566.638396:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744566.638436:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875634154582016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788744566.638565:0:19228:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788744566.638578:0:19228:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788744566.638580:0:19228:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788744566.638582:0:19228:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788744567 -> 1788744567 00002000:00010000:1.0:1788744566.638584:0:19228:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1788744566.639204:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639216:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639224:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639230:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.639234:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639249:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639265:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac64354c000) 00010000:00010000:0.0:1788744566.639268:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.639273:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639280:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcd8b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639299:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639305:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639311:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639316:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.639319:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639324:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639332:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac64354c900) 00010000:00010000:0.0:1788744566.639334:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.639337:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639351:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcd8ba lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639378:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639395:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639423:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639428:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.639431:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639437:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639445:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ac64354cd00) 00010000:00010000:0.0:1788744566.639448:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.639451:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639457:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcd962 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639472:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639477:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639490:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639495:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.639497:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639503:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639511:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:0.0:1788744566.639513:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744566.639516:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639521:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcd9e7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639532:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639538:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639543:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639547:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac774b58e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:0.0:1788744566.639549:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639564:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639571:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:0.0:1788744566.639573:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744566.639576:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.639582:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac774b58e00/0xb6207a6e76dcda5e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744566.639656:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac643f28000/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788744566.639663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac643f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875634154582016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788744566.642743:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875634154582016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4299us (5491us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788744566.642760:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744566.642918:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.647066:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781312 00000100:00100000:1.0:1788744566.647080:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781312 00000100:00100000:1.0:1788744566.647197:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1788744566.647208:0:18642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2394:x1875634138781312:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788744566.647329:0:18642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac644454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2394:x1875634138781312:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 122us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.647336:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1788744566.656813:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.660727:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781568 00000100:00100000:1.0:1788744566.660747:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781568 00000100:00100000:0.0:1788744566.662857:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1788744566.662873:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+15:15641:x1875634138781568:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744566.662929:0:18665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744566.662958:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dad600/0xb6207a6e76dcda73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d989 expref: 15 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.662979:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:0.0:1788744566.662984:0:18665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744566.663014:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcda81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.663027:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcda81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.664821:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcda81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744566.664984:0:18665:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000592e46c8 reply state 00000000464b17ed transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcda81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.665001:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170e00/0xb6207a6e76dcda81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.665010:0:18665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:0.0:1788744566.665013:0:18665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788744566.665017:0:18665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744566.665137:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+16:15641:x1875634138781568:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2265us (8330us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788744566.665146:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1788744566.668902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.669217:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781696 00000100:00100000:3.0:1788744566.669230:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781696 00000100:00100000:3.0:1788744566.669302:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1788744566.669312:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:15641:x1875634138781696:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744566.669331:0:18644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744566.669351:0:18644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d997 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.669399:0:18644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 8 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.669427:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744566.669431:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744566.669436:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 8 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.669469:0:18644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 8 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.669482:0:18644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 8 pid: 19540 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744566.669495:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac780fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18644:1875634154582144:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788744566.669571:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac753225a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744566.672667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.672709:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781824 00000100:00100000:2.0:1788744566.672722:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781824 00010000:00010000:2.0:1788744566.672775:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 9 pid: 19540 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744566.672818:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788744566.672858:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:2394:x1875634138781824:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744566.672877:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744566.672903:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 9 pid: 19540 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.672918:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 9 pid: 19540 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.672945:0:17122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744566.672949:0:17122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744566.672955:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 9 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.672965:0:17122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 9 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.673022:0:17122:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 9 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744566.673037:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fa7fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17122:1875634154582272:192.168.203.4@tcp:105: 00000100:00100000:2.0:1788744566.673110:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac774ab9a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788744566.674428:0:18644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021edfc10/0xb6207a6e76dcda7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d990 expref: 9 pid: 19540 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744566.674469:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac780fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18644:1875634154582144:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788744566.674499:0:18644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 8 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.674513:0:18644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac740030400, rc 0) 00000100:00100000:3.0:1788744566.674563:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+8:15641:x1875634138781696:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 5253us (5670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.674572:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1788744566.679084:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fa7fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17122:1875634154582272:192.168.203.4@tcp:105: 00010000:00010000:3.0:1788744566.679111:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744566.679175:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2394:x1875634138781824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 6319us (6519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744566.679185:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788744566.683967:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.684055:0:19228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138781952 00000100:00100000:1.0:1788744566.684065:0:19228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138781952 00000100:00100000:1.0:1788744566.684123:0:19228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788744566.684132:0:19228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2394:x1875634138781952:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788744566.684281:0:19228:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788744566.684285:0:19228:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788744567 00002000:00010000:1.0:1788744566.684288:0:19228:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788744566 00002000:00010000:1.0:1788744566.684290:0:19228:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788744567 -> 1788744567 00002000:00010000:1.0:1788744566.684292:0:19228:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788744566.684599:0:19228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+8:2394:x1875634138781952:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 466us (639us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788744566.684625:0:19228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788744566.696121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.696226:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782080 00000100:00100000:1.0:1788744566.696239:0:18642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782080 00000100:00100000:1.0:1788744566.696304:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1788744566.696315:0:18642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac74630bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+8:2396:x1875634138782080:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788744566.696372:0:18642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.696450:0:18642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 8 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.696461:0:18642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744566.696466:0:18642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744566.696471:0:18642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.696538:0:18642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 8 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.696554:0:18642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 8 pid: 18644 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.696570:0:18642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18642:1875634154582400:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744566.696661:0:18642:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75068a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744566.699476:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.699602:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782208 00000100:00100000:0.0:1788744566.699614:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782208 00010000:00010000:0.0:1788744566.699660:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 9 pid: 18644 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744566.699698:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788744566.699707:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:2394:x1875634138782208:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744566.699722:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744566.699744:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 9 pid: 18644 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.699758:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 9 pid: 18644 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.699799:0:17123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744566.699804:0:17123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744566.699809:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.699823:0:17123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.699853:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744566.699906:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+9:2394:x1875634138782208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 199us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.699914:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00010000:00010000:1.0:1788744566.700782:0:18642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcd05a2b/0xb6207a6e76dcda88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d997 expref: 8 pid: 18644 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.700815:0:18642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18642:1875634154582400:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744566.700846:0:18642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700858:0:18642:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700865:0:18642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700891:0:18642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700899:0:18642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700908:0:18642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700916:0:18642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744566.700920:0:18642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700929:0:18642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700951:0:18642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.700963:0:18642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcda8f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.701037:0:18642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac74630bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+7:2396:x1875634138782080:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 4724us (4927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.701045:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788744566.704227:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.704305:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782464 00000100:00100000:1.0:1788744566.704314:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782464 00000100:00100000:1.0:1788744566.704376:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1788744566.704392:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+16:15641:x1875634138782464:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788744566.704500:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.704517:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 16 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.704526:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.704555:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 16 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.704568:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 16 pid: 17138 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.704594:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154582528:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744566.704668:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75068a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744566.706848:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154582528:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744566.706874:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744566.708275:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.708681:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782592 00000100:00100000:2.0:1788744566.708693:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782592 00010000:00010000:2.0:1788744566.708734:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 17 pid: 17138 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744566.708808:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788744566.708819:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+17:2394:x1875634138782592:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744566.708844:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744566.708852:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 17 pid: 17138 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708865:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 17 pid: 17138 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708887:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740031400/0xb6207a6e76dcd9e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d958 expref: 17 pid: 17138 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708905:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:2.0:1788744566.708911:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 16 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708922:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708929:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708936:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.708966:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744566.709031:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+16:2394:x1875634138782592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 212us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.709046:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:1.0:1788744566.709122:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.709131:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.709345:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.709371:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.709379:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.709457:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.709470:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 16 pid: 17139 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.709483:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154582656:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788744566.709546:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75068a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744566.712582:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788744566.712681:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782720 00000100:00100000:2.0:1788744566.712694:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782720 00010000:00010000:2.0:1788744566.712734:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 17 pid: 17139 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744566.712774:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788744566.712783:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+17:2394:x1875634138782720:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744566.712797:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744566.712804:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 17 pid: 17139 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.712817:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 17 pid: 17139 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.712848:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:2.0:1788744566.712854:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.712863:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.712871:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744566.712890:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744566.712946:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+17:2394:x1875634138782720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.712969:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00010000:00010000:1.0:1788744566.713165:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac643dac000/0xb6207a6e76dcda65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d982 expref: 16 pid: 17139 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.713182:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154582656:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788744566.713203:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.713211:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.713217:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744566.713323:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788744566.713464:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788744566.713500:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788744566.713576:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17138:1875634154582784:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788744566.713621:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744566.713647:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac64355d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744566.714008:0:17878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154582784 00000100:00100000:2.0:1788744566.714015:0:17878:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154582784 00000100:00100000:2.0:1788744566.714052:0:17878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744566.714060:0:17878:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77fb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17138:x1875634154582784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788744566.714153:0:17878:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77fb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17138:x1875634154582784:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744566.714160:0:17878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788744566.715176:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17138:1875634154582784:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788744566.715357:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788744566.715475:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17138:1875634154582912:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788744566.715528:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744566.715551:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744566.715625:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634154582912 00000100:00100000:0.0:1788744566.715643:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634154582912 00000100:00100000:0.0:1788744566.715702:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744566.715711:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac77fb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17138:x1875634154582912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788744566.715870:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac77fb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17138:x1875634154582912:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (339us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788744566.715878:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744566.715994:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fb82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17138:1875634154582912:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788744566.716031:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716054:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716061:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716066:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47000 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744566.716071:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716078:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716092:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:1.0:1788744566.716094:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744566.716099:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716105:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcda9d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716135:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716142:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716147:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716152:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744566.716161:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716167:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716175:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.716177:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744566.716183:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716194:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716203:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.716255:0:17138:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac740030000/0xb6207a6e76dcd9fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d966 expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.716267:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ac77fb81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154583040:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788744566.716379:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ac75279ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744566.730131:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.730227:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782848 00000100:00100000:0.0:1788744566.730238:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782848 00000100:00100000:0.0:1788744566.730297:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788744566.730309:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+20:15640:x1875634138782848:12345-192.168.203.4@tcp:49:dd.0 00000100:00100000:0.0:1788744566.730481:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac745029050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+20:15640:x1875634138782848:12345-192.168.203.4@tcp:49:dd.0 Request processed in 174us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744566.730506:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788744566.730806:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ac77fb81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875634154583040:192.168.203.4@tcp:105: 00010000:00010000:1.0:1788744566.730843:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730854:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170200/0xb6207a6e76dcd9f5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730899:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730913:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730926:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730937:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730943:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730950:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730969:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47e00 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744566.730974:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730982:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.730994:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.730997:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744566.731001:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731007:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47e00/0xb6207a6e76dcdaa4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731024:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731031:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731037:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731041:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f46200 already unused, calling callback (ffffffffc1aec4f0) 00010000:00010000:1.0:1788744566.731044:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731051:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731058:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.731061:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744566.731064:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.731070:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f46200/0xb6207a6e76dcda96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.731186:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+19:15641:x1875634138782464:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 26800us (26966us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788744566.731195:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000020:00080000:1.0:1788744566.731199:0:17138:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788744566.734282:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788744566.734293:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744566.734312:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788744566.734318:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788744566.735740:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.735779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788744566.735871:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138783232 00000100:00100000:0.0:1788744566.735881:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138783232 00000100:00100000:0.0:1788744566.735936:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788744566.735946:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+19:15641:x1875634138783232:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788744566.736205:0:17141:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788744566.736238:0:17141:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788744566.736273:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.736292:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.736304:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.736313:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.736318:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.736325:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.736354:0:17141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744566.736478:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+21:15641:x1875634138783232:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 532us (696us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788744566.736487:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000020:00080000:0.0:1788744566.736491:0:17141:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788744566.736863:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138782976 00000100:00100000:1.0:1788744566.736870:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138782976 00000100:00100000:1.0:1788744566.736908:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1788744566.736916:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+21:15640:x1875634138782976:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1788744566.736928:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744566.736940:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcdab2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7053de4f1aa0d99e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.736969:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcdab9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.736979:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcdab9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.736987:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcdab9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.737075:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47000/0xb6207a6e76dcdab2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d99e expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.737091:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac773f47200/0xb6207a6e76dcdab9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x7053de4f1aa0d99e expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.737099:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac64354c600) 00010000:00010000:1.0:1788744566.737102:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744566.737106:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac773f47200, rc 0) 00000100:00100000:1.0:1788744566.737147:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+22:15640:x1875634138782976:12345-192.168.203.4@tcp:101:dd.0 Request processed in 232us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744566.737154:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00010000:00010000:3.0:1788744566.737217:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744566.737224:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.737242:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170a00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:3.0:1788744566.737246:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.737255:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.737265:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac64354c100) 00010000:00010000:3.0:1788744566.737268:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744566.737272:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.737277:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac782170a00/0xb6207a6e76dcdaab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744566.737289:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744566.737291:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744566.737292:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744566.885457:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788744566.885494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788744566.885613:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138783488 00000100:00100000:1.0:1788744566.885629:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138783488 00000100:00100000:0.0:1788744566.885673:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634138783360 00000100:00100000:0.0:1788744566.885678:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634138783360 00000100:00100000:0.0:1788744566.885716:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788744566.885786:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+8:2396:x1875634138783488:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:0.0:1788744566.885845:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9e1377, atime: 0x6a9e1376, ctime: 0x6a9e1377, blocks: 0x0 00010000:00010000:0.0:1788744566.885855:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.885870:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788744566.885875:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744566.885882:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744566.885897:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744566.958288:0:18639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788744566.958305:0:18639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:0.0:1788744566.958723:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744566.959122:0:18648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788744566.959129:0:18648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788744566.959150:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959167:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959178:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959187:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac782170c00 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:1.0:1788744566.959192:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959203:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959226:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959234:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80962bc/0xb6207a6e76dcdac0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744566.959453:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+6:2396:x1875634138783488:12345-192.168.203.4@tcp:4:dd.0 Request processed in 73663us (74052us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788744566.959465:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788744566.959516:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788744566.959531:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac780fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2396:x1875634138783360:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:1.0:1788744566.959580:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a9e1377, atime: 0x6a9e1376, ctime: 0x6a9e1377, blocks: 0x1a68 00010000:00010000:1.0:1788744566.959589:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959601:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788744566.959607:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744566.959613:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744566.959625:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744567.019351:0:18639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788744567.019930:0:18648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788744567.019952:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744567.019966:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744567.019987:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744567.019995:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac773f47000 already unused, calling callback (ffffffffc0e92940) 00010000:00010000:0.0:1788744567.020000:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744567.020010:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744567.020031:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744567.020039:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f676f80/0xb6207a6e76dcdac7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744567.020208:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac780fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2827ee7-baa9-49cc-a7aa-8f8d036c38af+5:2396:x1875634138783360:12345-192.168.203.4@tcp:4:dd.0 Request processed in 60677us (134707us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788744567.020219:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00010000:00010000:1.0:1788744567.982581:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744568.602777:0:20313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788744569.006746:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744570.046800:0:19539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41795 lines, 41795 kept, 0 dropped, 0 bad.